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Preface  to  the  First  Edition  A  study  of  this  book,  and  espe¬ 
cially  the  exercises,  should  give  the  reader  a  thorough  understanding 
of  a  few  basic  concepts  in  analysis  such  as  continuity,  convergence 
of  sequences  and  series  of  numbers,  and  convergence  of  sequences 
and  series  of  functions.  An  ability  to  read  and  write  proofs  will 
be  stressed.  A  precise  knowledge  of  definitions  is  essential.  The  be¬ 
ginner  should  memorize  them;  such  memorization  will  help  lead  to 
understanding. 

Chapter  1  sets  the  scene  and,  except  for  the  completeness  axiom, 
should  be  more  or  less  familiar.  Accordingly,  readers  and  instructors 
are  urged  to  move  quickly  through  this  chapter  and  refer  back  to  it 
when  necessary.  The  most  critical  sections  in  the  book  are  §§7-12  in 
Chap.  2.  If  these  sections  are  thoroughly  digested  and  understood, 
the  remainder  of  the  book  should  be  smooth  sailing. 

The  first  four  chapters  form  a  unit  for  a  short  course  on  analysis. 
I  cover  these  four  chapters  (except  for  the  enrichment  sections  and 
§20)  in  about  38  class  periods;  this  includes  time  for  quizzes  and 
examinations.  For  such  a  short  course,  my  philosophy  is  that  the 
students  are  relatively  comfortable  with  derivatives  and  integrals  but 
do  not  really  understand  sequences  and  series,  much  less  sequences 
and  series  of  functions,  so  Chaps.  1-4  focus  on  these  topics.  On  two 
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or  three  occasions,  I  draw  on  the  Fundamental  Theorem  of  Calculus 
or  the  Mean  Value  Theorem,  which  appears  later  in  the  book,  but  of 
course  these  important  theorems  are  at  least  discussed  in  a  standard 
calculus  class. 

In  the  early  sections,  especially  in  Chap.  2,  the  proofs  are  very 
detailed  with  careful  references  for  even  the  most  elementary  facts. 
Most  sophisticated  readers  find  excessive  details  and  references  a 
hindrance  (they  break  the  flow  of  the  proof  and  tend  to  obscure  the 
main  ideas)  and  would  prefer  to  check  the  items  mentally  as  they 
proceed.  Accordingly,  in  later  chapters,  the  proofs  will  be  somewhat 
less  detailed,  and  references  for  the  simplest  facts  will  often  be  omit¬ 
ted.  This  should  help  prepare  the  reader  for  more  advanced  books 
which  frequently  give  very  brief  arguments. 

Mastery  of  the  basic  concepts  in  this  book  should  make  the 
analysis  in  such  areas  as  complex  variables,  differential  equations, 
numerical  analysis,  and  statistics  more  meaningful.  The  book  can 
also  serve  as  a  foundation  for  an  in-depth  study  of  real  analysis 
given  in  books  such  as  [4,33,34,53,62,65]  listed  in  the  bibliography. 

Readers  planning  to  teach  calculus  will  also  benefit  from  a  careful 
study  of  analysis.  Even  after  studying  this  book  (or  writing  it),  it  will 
not  be  easy  to  handle  questions  such  as  “What  is  a  number?”  but 
at  least  this  book  should  help  give  a  clearer  picture  of  the  subtleties 
to  which  such  questions  lead. 

The  enrichment  sections  contain  discussions  of  some  topics  that  I 
think  are  important  or  interesting.  Sometimes  the  topic  is  dealt  with 
lightly,  and  suggestions  for  further  reading  are  given.  Though  these 
sections  are  not  particularly  designed  for  classroom  use,  I  hope  that 
some  readers  will  use  them  to  broaden  their  horizons  and  see  how 
this  material  fits  in  the  general  scheme  of  things. 

I  have  benefitted  from  numerous  helpful  suggestions  from  my  col¬ 
leagues  Robert  Freeman,  William  Kantor,  Richard  Koch,  and  John 
Leahy  and  from  Timothy  Hall,  Girnli  Khazad,  and  Jorge  Lopez.  I 
have  also  had  helpful  conversations  with  my  wife  Lynn  concerning 
grammar  and  taste.  Of  course,  remaining  errors  in  grammar  and 
mathematics  are  the  responsibility  of  the  author. 

Several  users  have  supplied  me  with  corrections  and  suggestions 
that  I’ve  incorporated  in  subsequent  printings.  I  thank  them  all, 
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including  Robert  Messer  of  Albion  College,  who  caught  a  subtle  error 
in  the  proof  of  Theorem  12.1. 

Preface  to  the  Second  Edition  After  32  years,  it  seemed  time 
to  revise  this  book.  Since  the  first  edition  was  so  successful,  I  have 
retained  the  format  and  material  from  the  first  edition.  The  num¬ 
bering  of  theorems,  examples,  and  exercises  in  each  section  will  be 
the  same,  and  new  material  will  be  added  to  some  of  the  sections. 
Every  rule  has  an  exception,  and  this  rule  is  no  exception.  In  §11, 
a  theorem  (Theorem  11.2)  has  been  added,  which  allows  the  sim¬ 
plification  of  four  almost-identical  proofs  in  the  section:  Examples  3 
and  4,  Theorem  11.7  (formerly  Corollary  11.4),  and  Theorem  11.8 
(formerly  Theorem  11.7). 

Where  appropriate,  the  presentation  has  been  improved.  See  es¬ 
pecially  the  proof  of  the  Chain  Rule  28.4,  the  shorter  proof  of  Abel’s 
Theorem  26.6,  and  the  shorter  treatment  of  decimal  expansions  in 
§16.  Also,  a  few  examples  have  been  added,  a  few  exercises  have  been 
modified  or  added,  and  a  couple  of  exercises  have  been  deleted. 

Here  are  the  main  additions  to  this  revision.  The  proof  of  the 
irrationality  of  e  in  §16  is  now  accompanied  by  an  elegant  proof  that 
7 r  is  also  irrational.  Even  though  this  is  an  “enrichment”  section, 
it  is  especially  recommended  for  those  who  teach  or  will  teach  pre¬ 
college  mathematics.  The  Baire  Category  Theorem  and  interesting 
consequences  have  been  added  to  the  enrichment  §21.  Section  31,  on 
Taylor’s  Theorem,  has  been  overhauled.  It  now  includes  a  discussion 
of  Newton’s  method  for  approximating  zeros  of  functions,  as  well 
as  its  cousin,  the  secant  method.  Proofs  are  provided  for  theorems 
that  guarantee  when  these  approximation  methods  work.  Section  35 
on  Riemann-Stieltjes  integrals  has  been  improved  and  expanded. 
A  new  section,  §38,  contains  an  example  of  a  continuous  nowhere- 
differentiable  function  and  a  theorem  that  shows  “most”  continuous 
functions  are  nowhere  differentiable.  Also,  each  of  §§22,  32,  and  33 
has  been  modestly  enhanced. 

It  is  a  pleasure  to  thank  many  people  who  have  helped  over 
the  years  since  the  first  edition  appeared  in  1980.  This  includes 
David  M.  Bloom,  Robert  B.  Burckel,  Kai  Lai  Chung,  Mark  Dalthorp 
(grandson),  M.  K.  Das  (India),  Richard  Dowds,  Ray  Hoobler, 
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Richard  M.  Koch,  Lisa  J.  Madsen,  Pablo  V.  Negron  Marrero 
(Puerto  Rico),  Rajiv  Monsurate  (India),  Theodore  W.  Palmer,  Jiirg 
Ratz  (Switzerland),  Peter  Renz,  Karl  Stromberg,  and  Jesus  Sueiras 
(Puerto  Rico). 

Special  thanks  go  to  my  collaborator,  Jorge  M.  Lopez,  who  pro¬ 
vided  a  huge  amount  of  help  and  support  with  the  revision.  Working 
with  him  was  also  a  lot  of  fun.  My  plan  to  revise  the  book  was  sup¬ 
ported  from  the  beginning  by  my  wife,  Ruth  Madsen  Ross.  Finally, 
I  thank  my  editor  at  Springer,  Kaitlin  Leach,  who  was  attentive  to 
my  needs  whenever  they  arose. 

Especially  for  the  Student:  Don’t  be  dismayed  if  you  run  into 
material  that  doesn’t  make  sense,  for  whatever  reason.  It  happens 
to  all  of  us.  Just  tentatively  accept  the  result  as  true,  set  it  aside  as 
something  to  return  to,  and  forge  ahead.  Also,  don’t  forget  to  use  the 
Index  or  Symbols  Index  if  some  terminology  or  notation  is  puzzling. 
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Introduction 


The  underlying  space  for  all  the  analysis  in  this  book  is  the  set  of 
real  numbers.  In  this  chapter  we  set  down  some  basic  properties  of 
this  set.  These  properties  will  serve  as  our  axioms  in  the  sense  that 
it  is  possible  to  derive  all  the  properties  of  the  real  numbers  using 
only  these  axioms.  However,  we  will  avoid  getting  bogged  down  in 
this  endeavor.  Some  readers  may  wish  to  refer  to  the  appendix  on 
set  notation. 


§1  The  Set  N  of  Natural  Numbers 

We  denote  the  set  {1,2,3,...}  of  all  positive  integers  by  N.  Each 
positive  integer  n  has  a  successor,  namely  n  +  1.  Thus  the  successor 
of  2  is  3,  and  37  is  the  successor  of  36.  You  will  probably  agree  that 
the  following  properties  of  N  are  obvious;  at  least  the  first  four  are. 

Nl.  1  belongs  to  N. 

N2.  If  n  belongs  to  N,  then  its  successor  n  +  1  belongs  to  N. 

N3.  1  is  not  the  successor  of  any  element  in  N. 
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N4.  If  n  and  m  in  N  have  the  same  successor,  then  n  =  m. 

N5.  A  subset  of  N  which  contains  1,  and  which  contains  n  +  1 
whenever  it  contains  n,  must  equal  N. 

Properties  N1  through  N5  are  known  as  the  Peano  Axioms  or 
Peano  Postulates.  It  turns  out  most  familiar  properties  of  N  can  be 
proved  based  on  these  five  axioms;  see  [8]  or  [39]. 

Let’s  focus  our  attention  on  axiom  N5,  the  one  axiom  that  may 
not  be  obvious.  Here  is  what  the  axiom  is  saying.  Consider  a  subset 
S  of  N  as  described  in  N5.  Then  1  belongs  to  S.  Since  S  contains 
n  +  1  whenever  it  contains  n,  it  follows  that  S  contains  2  =  1  +  1. 
Again,  since  S  contains  n  +  1  whenever  it  contains  n,  it  follows  that 
S  contains  3  =  2  +  1.  Once  again,  since  S  contains  n  +  1  whenever  it 
contains  n,  it  follows  that  S  contains  4  =  3+1.  We  could  continue  this 
monotonous  line  of  reasoning  to  conclude  S  contains  any  number  in 
N.  Thus  it  seems  reasonable  to  conclude  S  =  N.  It  is  this  reasonable 
conclusion  that  is  asserted  by  axiom  N5. 

Here  is  another  way  to  view  axiom  N5.  Assume  axiom  N5  is  false. 
Then  N  contains  a  set  S  such  that 

(i)  1  €  5, 

(ii)  If  n  6  S,  then  n  +  lsS, 

and  yet  S  ^  N.  Consider  the  smallest  member  of  the  set  {n  E  N  : 
n  0  S'},  call  it  no-  Since  (i)  holds,  it  is  clear  no  ^  1.  So  no  is  a 
successor  to  some  number  in  N,  namely  no  —  1.  We  have  no  —  1  €E  S 
since  no  is  the  smallest  member  of  {n  6  N  :  n  ^  S}.  By  (ii),  the 
successor  of  no  —  1,  namely  no,  is  also  in  S,  which  is  a  contradiction. 
This  discussion  may  be  plausible,  but  we  emphasize  that  we  have  not 
proved  axiom  N5  using  the  successor  notion  and  axioms  N1  through 
N4,  because  we  implicitly  used  two  unproven  facts.  We  assumed 
every  nonempty  subset  of  N  contains  a  least  element  and  we  assumed 
that  if  no  7^  1  then  no  is  the  successor  to  some  number  in  N. 

Axiom  N5  is  the  basis  of  mathematical  induction.  Let  Pi,P2, 
+3, . . .  be  a  list  of  statements  or  propositions  that  may  or  may 
not  be  true.  The  principle  of  mathematical  induction  asserts  all  the 
statements  Pi,  P2,  P3,  ■  ■ .  are  true  provided 

(11)  Hi  is  true, 

(12)  Pt+i  is  true  whenever  Pn  is  true. 
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We  will  refer  to  (Ii),  i.e.,  the  fact  that  P\  is  true,  as  the  basis  for 
induction  and  we  will  refer  to  (I2)  as  the  induction  step.  For  a  sound 
proof  based  on  mathematical  induction,  properties  (Ii)  and  (I2)  must 
both  be  verified.  In  practice,  (Ii)  will  be  easy  to  check. 

Example  1 

Prove  1  +  2  +  •  •  •  +  n  =  ~n(n  +  1)  for  positive  integers  n.  □ 

Solution 

Our  nth  proposition  is 

Pn:  “1  +  2  H - 1 -n=  ^n(n  +  1).” 

Thus  Pi  asserts  1  =  2'  1(1  +  1)>  -P2  asserts  1  +  2  =  5-  2(2  +  1),  P37 
asserts  l  +  2  +  --  -  +  37=5  -  37(37  +  1)  =  703,  etc.  In  particular,  Pi 
is  a  true  assertion  which  serves  as  our  basis  for  induction. 

For  the  induction  step,  suppose  Pn  is  true.  That  is,  we  suppose 

1  +  2  H - +  n  =  \n{n  +  1) 

is  true.  Since  we  wish  to  prove  Pn+ 1  from  this,  we  add  n  +  1  to  both 
sides  to  obtain 

1  +  2H - hn+(n+l)  =  \n{n  +  1)  +  (n  +  1) 

=  l[n(n  +  1)  +  2(n  +  1)]  =  \{n  +  l)(n  +  2) 
=  \{n  +  l)((n  +  1)  +  1). 

Thus  Pn-|-i  holds  if  Pn  holds.  By  the  principle  of  mathematical 
induction,  we  conclude  Pn  is  true  for  all  n.  □ 

We  emphasize  that  prior  to  the  last  sentence  of  our  solution  we 
did  not  prove  “Pn+i  is  true.”  We  merely  proved  an  implication:  “if  Pn 
is  true,  then  Pn+\  is  true.”  In  a  sense  we  proved  an  infinite  number 
of  assertions,  namely:  Pi  is  true;  if  Pi  is  true  then  P2  is  true;  if  P2 
is  true  then  P3  is  true;  if  P3  is  true  then  P4  is  true;  etc.  Then  we 
applied  mathematical  induction  to  conclude  Pi  is  true,  P2  is  true,  P3 
is  true,  P4  is  true,  etc.  We  also  confess  that  formulas  like  the  one  just 
proved  are  easier  to  prove  than  to  discover.  It  can  be  a  tricky  matter 
to  guess  such  a  result.  Sometimes  results  such  as  this  are  discovered 
by  trial  and  error. 
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Example  2 

All  numbers  of  the  form  5n  —  4n  —  1  are  divisible  by  16.  □ 

Solution 

More  precisely,  we  show  5n  —  4n  —  1  is  divisible  by  16  for  each  n  in 
N.  Our  nth  proposition  is 

Pn:  “5n  —  4n  —  1  is  divisible  by  16.” 

The  basis  for  induction  Pi  is  clearly  true,  since  51  —  4  •  1  —  1  =  0. 
Proposition  P2  is  also  true  because  52  —  4  •  2  —  1  =  16,  but  note 
we  didn’t  need  to  check  this  case  before  proceeding  to  the  induction 
step.  For  the  induction  step,  suppose  Pn  is  true.  To  verify  Pn+ 1,  the 
trick  is  to  write 

5n+1  -  4(n  +  1)  -  1  =  5(5n  -  4n  -  1)  +  16n. 

Since  5n  —  4n  —  1  is  a  multiple  of  16  by  the  induction  hypothesis,  it 
follows  that  5n+1  —  4(n  +  1)  —  1  is  also  a  multiple  of  16.  In  fact,  if 
5n  —  4n  —  1  =  16m,  then  5n+1  —  4(n  + 1)  —  1  =  16  •  (5m +  n).  We  have 
shown  Pn  implies  Pn+i,  so  the  induction  step  holds.  An  application 
of  mathematical  induction  completes  the  proof.  □ 

Example  3 

Show  |sinnx|  <  n|sinx|  for  all  positive  integers  n  and  all  real 
numbers  x.  □ 

Solution 

Our  nth  proposition  is 

Pn :  “|  sinnx|  <  n\  sin  x \  for  all  real  numbers  x .” 

The  basis  for  induction  is  again  clear.  Suppose  Pn  is  true.  We  apply 
the  addition  formula  for  sine  to  obtain 

|  sin(n  +  1)®|  =  |  sin(mc  +  x)|  =  |  sin  nx cos x  +  cosna;sinx|. 

Now  we  apply  the  Triangle  Inequality  and  properties  of  the  absolute 
value  [see  Theorems  3.7  and  3.5]  to  obtain 

|  sin(n  +  l)x|  <  |  sinnx|  •  |  cosx|  +  |  cosna;|  •  |  sinx|. 

Since  |  cosy\  <  1  for  all  y  we  see  that 
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Now  we  apply  the  induction  hypothesis  Pn  to  obtain 

|  sin(n  +  V)x\  <  n|  sinx|  +  |  sinx|  =  (n  +  1)|  sinx|. 

Thus  Pn+i  holds.  Finally,  the  result  holds  for  all  n  by  mathematical 
induction.  □ 


Exercises 

1.1  Prove  l2  +  22  +  -  •  -+n2  =  |n(n+  l)(2n  + 1)  for  all  positive  integers  n. 

1.2  Prove  3  +  11  +  •  •  •  +  (8n  —  5)  =  4n2  —  n  for  all  positive  integers  n. 

1.3  Prove  13  +  23H - \-n3  =  (1  +  2H - bn)2  for  all  positive  integers  n. 

1.4  (a)  Guess  a  formula  for  1  +  3  H —  •  +  (2 n  —  1)  by  evaluating  the  sum 

for  n  =  1,2,  3,  and  4.  [For  n  =  1,  the  sum  is  simply  1.] 

(b)  Prove  your  formula  using  mathematical  induction. 

1.5  Prove  1  +  \  +  \  H - +  ^  =  2  —  A-  for  all  positive  integers  n. 

1.6  Prove  (ll)n  —  4"  is  divisible  by  7  when  n  is  a  positive  integer. 

1.7  Prove  7n  —  6n  —  1  is  divisible  by  36  for  all  positive  integers  n. 

1.8  The  principle  of  mathematical  induction  can  be  extended  as  follows. 
A  list  Pm,  Prn+i , ...  of  propositions  is  true  provided  (i)  Pm  is  true, 
(ii)  Pn+ 1  is  true  whenever  Pn  is  true  and  n>  m. 

(a)  Prove  n2  >  n  +  1  for  all  integers  n  >  2. 

(b)  Prove  n!  >  n2  for  all  integers  n  >  4.  [Recall  n!  =  n(n—  1)  •  •  •  2 •  1; 
for  example,  5!  =  5-  4-  3-  2-  l  =  120.] 

1.9  (a)  Decide  for  which  integers  the  inequality  2"  >  n2  is  true. 

(b)  Prove  your  claim  in  (a)  by  mathematical  induction. 

1.10  Prove  (2 n  +  1)  +  (2 n  +  3)  +  (2n  +  5)  +  •  •  •  +  (4n  —  1)  =  3n2  for  all 
positive  integers  n. 

1.11  For  each  n  £  N,  let  Pn  denote  the  assertion  “n2  +  5n  +  1  is  an  even 
integer.” 

(a)  Prove  Pn+i  is  true  whenever  Pn  is  true. 

(b)  For  which  n  is  Pn  actually  true?  What  is  the  moral  of  this 
exercise? 
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1.12  For  neN,  let  n!  [read  “n  factorial”]  denote  the  product  1-2-3  ■  ■  -  n. 
Also  let  0!  =  1  and  define 

7„\ ,  for  fc  =  0,l,...,n.  (1.1) 


k\(n  —  fc)! 

The  binomial  theorem  asserts  that 

(“+‘)"=(>"+(>”~,6+GKa  62+  ■  +(„I>6— +(>' 


=aTl+naTl_1b+-n(n— l)aTl_262+  -  -  -  +nabn~1  +bn . 


(a)  Verify  the  binomial  theorem  for  n  =  1,2,  and  3. 

(b)  Show  (;)  +  (*:,)  =  (”+')  for  *  =  1, 2 . n. 

(c)  Prove  the  binomial  theorem  using  mathematical  induction  and 
part  (b). 


§2  The  Set  Q  of  Rational  Numbers 

Small  children  first  learn  to  add  and  to  multiply  positive  integers. 
After  subtraction  is  introduced,  the  need  to  expand  the  number  sys¬ 
tem  to  include  0  and  negative  integers  becomes  apparent.  At  this 
point  the  world  of  numbers  is  enlarged  to  include  the  set  Z  of  all 
integers.  Thus  we  have  Z  =  {0, 1,  —1,2,  —2, . . .}. 

Soon  the  space  Z  also  becomes  inadequate  when  division  is  in¬ 
troduced.  The  solution  is  to  enlarge  the  world  of  numbers  to  include 
all  fractions.  Accordingly,  we  study  the  space  Q  of  all  rational  num¬ 
bers ,  i.e. ,  numbers  of  the  form  ^  where  m,n  G  Z  and  n  /  0.  Note 
that  Q  contains  all  terminating  decimals  such  as  1.492  =  .  The 

connection  between  decimals  and  real  numbers  is  discussed  in  10.3 
on  page  58  and  in  §16.  The  space  Q  is  a  highly  satisfactory  alge¬ 
braic  system  in  which  the  basic  operations  addition,  multiplication, 
subtraction  and  division  can  be  fully  studied.  No  system  is  perfect, 
however,  and  Q  is  inadequate  in  some  ways.  In  this  section  we  will 
consider  the  defects  of  Q.  In  the  next  section  we  will  stress  the  good 
features  of  Q  and  then  move  on  to  the  system  of  real  numbers. 

The  set  Q  of  rational  numbers  is  a  very  nice  algebraic  system  until 
one  tries  to  solve  equations  like  x2  =  2.  It  turns  out  that  no  rational 
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FIGURE  2.1 


number  satisfies  this  equation,  and  yet  there  are  good  reasons  to 
believe  some  kind  of  number  satisfies  this  equation.  Consider,  for 
example,  a  square  with  sides  having  length  one;  see  Fig.  2.1.  If  d  is 
the  length  of  the  diagonal,  then  from  geometry  we  know  12  +  12  =  d 2, 
i.e.,  d2  =  2.  Apparently  there  is  a  positive  length  whose  square  is  2, 
which  we  write  as  \[2.  But  y/ 2  cannot  be  a  rational  number,  as  we  will 
show  in  Example  2.  Of  course,  y/2  can  be  approximated  by  rational 
numbers.  There  are  rational  numbers  whose  squares  are  close  to  2; 
for  example,  (1.4142)2  =  1.99996164  and  (1.4143)2  =  2.00024449. 

It  is  evident  that  there  are  lots  of  rational  numbers  and  yet  there 
are  “gaps”  in  Q.  Here  is  another  way  to  view  this  situation.  Consider 
the  graph  of  the  polynomial  x2  —  2  in  Fig.  2.2.  Does  the  graph  of  x2  —  2 
cross  the  x-axis?  We  are  inclined  to  say  it  does,  because  when  we 
draw  the  x-axis  we  include  “all”  the  points.  We  allow  no  “gaps.”  But 
notice  that  the  graph  of  x2  —  2  slips  by  all  the  rational  numbers  on 
the  x-axis.  The  x-axis  is  our  picture  of  the  number  line,  and  the  set 
of  rational  numbers  again  appears  to  have  significant  “gaps.” 

There  are  even  more  exotic  numbers  such  as  ir  and  e  that  are  not 
rational  numbers,  but  which  come  up  naturally  in  mathematics.  The 
number  n  is  basic  to  the  study  of  circles  and  spheres,  and  e  arises  in 
problems  of  exponential  growth. 

We  return  to  y/2.  This  is  an  example  of  what  is  called  an  algebraic 
number  because  it  satisfies  the  equation  x2  —  2  =  0. 
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2.1  Definition. 

A  number  is  called  an  algebraic  number  if  it  satisfies  a  polynomial 
equation 


Cnxn  +  cn—  \Xn  +  •  ■  ■  +  C]  X  +  Co  —  0 
where  the  coefficients  co,  ci, . . . ,  cn  are  integers,  cn  ^  0  and  n  >  1. 

Rational  numbers  are  always  algebraic  numbers.  In  fact,  if  r  =  — 
is  a  rational  number  [ m,n  6  Z  and  n  ^  0],  then  it  satisfies  the 
equation  nx  —  m  =  0.  Numbers  defined  in  terms  of  \/  ,  etc.  [or 
fractional  exponents,  if  you  prefer]  and  ordinary  algebraic  operations 
on  the  rational  numbers  are  invariably  algebraic  numbers. 


Example  1 

j4f,  \/3,  v^17,  \/2  +  \/5  and  \j are  algebraic  numbers.  In  fact, 
Yj  is  a  solution  of  17 x  —  4  =  0,  \/3  is  a  solution  of  x1  —  3  =  0,  and 

<yi7  is  a  solution  of  x3  —  17  =  0.  The  expression  a  =  y/ 2+  \/h  means 
a2  =  2  +  or  a2  —  2  =  v^5  so  that  (a2  —  2)3  =  5.  Therefore  we 
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have  a6  —  6a4  +  12a2  —  13  =  0,  which  shows  a  =  y/ 2  +  y/h  satisfies 
the  polynomial  equation  x6  —  6x4  +  12x2  —  13  =  0. 

Similarly,  the  expression  b  =  J 4~2v^  leads  to  7b2  =  4  —  2-\/3, 

hence  2\/3  =  4— 7b2,  hence  12  =  (4— 7b2)2,  hence  4964  — 5662±4  =  0. 
Thus  b  satisfies  the  polynomial  equation  49x4  —  56x2  +  4  =  0.  □ 

The  next  theorem  may  be  familiar  from  elementary  algebra.  It  is 
the  theorem  that  justifies  the  following  remarks:  the  only  possible  ra¬ 
tional  solutions  of  x3  — 7x2+2x  — 12  =  0  are  ±1,  ±2,  ±3,  ±4,  ±6,  ±12, 
so  the  only  possible  (rational)  monomial  factors  of  x3  —  7x2  +  2x  —  12 
are  x  —  1,  x  +  1,  x  —  2,  x  +  2,  x  —  3,  x  +  3,  x  —  4,  x  +  4,  x  —  6,  x  +  6, 
x  —  12,  x  +  12.  We  won’t  pursue  these  algebraic  problems;  we  merely 
make  these  observations  in  the  hope  they  will  be  familiar. 

The  next  theorem  also  allows  one  to  prove  algebraic  numbers  that 
do  not  look  like  rational  numbers  are  usually  not  rational  numbers. 
Thus  y/4  is  obviously  a  rational  number,  while  y/2,  y/3,  y/5,  etc. 
turn  out  to  be  nonrational.  See  the  examples  following  the  theorem. 
Also,  compare  Exercise  2.7.  Recall  that  an  integer  k  is  a  factor  of  an 
integer  m  or  divides  rn  if  ff  is  also  an  integer. 

If  the  next  theorem  seems  complicated,  first  read  the  special  case 
in  Corollary  2.3  and  Examples  2-5. 

2.2  Rational  Zeros  Theorem. 

Suppose  co,ci,...,cn  are  integers  and  r  is  a  rational  number 
satisfying  the  polynomial  equation 

cnxn  +  cn- ixn~l  H - h  cix  +  c0  =  0  (1) 

where  n  >  1.  cn  ^  0  and  cq  ^  0.  Let  r  =  |  where  c,  d  are  inte¬ 
gers  having  no  common  factors  and  d  ^  0.  Then  c  divides  Co  and  d 
divides  cn. 

In  other  words,  the  only  rational  candidates  for  solutions  of  (1) 
have  the  form  ^  where  c  divides  Co  and  d  divides  cn. 

Proof 

We  are  given 
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We  multiply  through  by  dn  and  obtain 

cncn  +  cn_icn_1d  +  cn_2Cn_2d2H - hC2C2dT!_2  +  cicdn^1  +  cociTl  =  0. 

(2) 

If  we  solve  for  co«f\  we  obtain 

c0dn  =  -c[cncn_1  +  cn_icn_2d+cn_2Cn_3d2H - \-c2cdn~'2  +  cidn_1]. 

It  follows  that  c  divides  cq dn.  But  c  and  dn  have  no  common  factors, 
so  c  divides  cq.  This  follows  from  the  basic  fact  that  if  an  integer 
c  divides  a  product  ab  of  integers,  and  if  c  and  b  have  no  common 
factors,  then  c  divides  a.  See,  for  example,  Theorem  1.10  in  [50]. 
Now  we  solve  (2)  for  cncn  and  obtain 

cncn  =  -d[cn_icn_1+cn_2c?l_2dH - bC2C2dn-3+cicdn~2  +  codn-1]. 

Thus  d  divides  cncn.  Since  cn  and  d  have  no  common  factors, 
d  divides  cn.  ■ 

2.3  Corollary. 

Consider  the  polynomial  equation 

x11  +  cn-ixn~l  H - h  cix  +  c0  =  0, 

where  the  coefficients  co,ci, . . . ,  cn_i  are  integers  and  Co  ^  0.1  Any 
rational  solution  of  this  equation  must  be  an  integer  that  divides  Co . 

Proof 

In  the  Rational  Zeros  Theorem  2.2,  the  denominator  of  r  must  divide 
the  coefficient  of  xn,  which  is  1  in  this  case.  Thus  r  is  an  integer  and 
it  divides  Co-  ■ 

Example  2 

y/2  is  not  a  rational  number.  □ 

Proof 

By  Corollary  2.3,  the  only  rational  numbers  that  could  possibly  be 
solutions  of  x2  —  2  =  0  are  ±1,±2.  [Here  n  =  2,  C2  =  1,  ci  =  0, 
cq  =  —2.  So  the  rational  solutions  have  the  form  ^  where  c  divides 


1  Polynomials  like  this,  where  the  highest  power  has  coefficient  1,  are  called  monic 

polynomials. 
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Co  =  —2  and  d  divides  C2  =  1.]  One  can  substitute  each  of  the  four 
numbers  ±1,±2  into  the  equation  x2  —  2  =  0  to  quickly  eliminate 
them  as  possible  solutions  of  the  equation.  Since  \/2  is  a  solution  of 
x2  —  2  =  0,  it  cannot  be  a  rational  number.  ■ 

Example  3 

y/l7  is  not  a  rational  number.  □ 

Proof 

The  only  possible  rational  solutions  of  x2  —  17  =  0  are  ±1,  ±17,  and 
none  of  these  numbers  are  solutions.  ■ 


Example  4 

^6  is  not  a  rational  number.  □ 


Proof 

The  only  possible  rational  solutions  of  x3  —  6  =  0  are  ±1,  ±2,  ±3,  ±6. 
It  is  easy  to  verify  that  none  of  these  eight  numbers  satisfies  the 
equation  x3  —  6  =  0.  ■ 

Example  5 

a  =  \/2  +  V5  is  not  a  rational  number.  □ 


Proof 

In  Example  1  we  showed  a  is  a  solution  of  x6  —  6x4  +  12x2  —  13  =  0. 
By  Corollary  2.3,  the  only  possible  rational  solutions  are  ±1,±13. 
When  x  =  1  or  —  1,  the  left  hand  side  of  the  equation  is  —6  and 
when  x  =  13  or  —13,  the  left  hand  side  of  the  equation  turns  out  to 
equal  4,657,458.  This  last  computation  could  be  avoided  by  using  a 
little  common  sense.  Either  observe  a  is  “obviously”  bigger  than  1 
and  less  than  13,  or  observe 

136  —  6  •  134  +  12  •  132  -  13  =  13(135  -  6  ■  133  +  12  •  13  -  1)  ±  0 

since  the  term  in  parentheses  cannot  be  zero:  it  is  one  less  than  some 
multiple  of  13.  ■ 


Example  6 

b  =  \J '4~2v ^  is  not  a  rational  number. 


□ 
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Proof 

In  Example  1  we  showed  b  is  a  solution  of  49x4  —  56x2  +  4  =  0.  By 
Theorem  2.2,  the  only  possible  rational  solutions  are 

±1,  ±1/7,  ±1/49,  ±2,  ±2/7,  ±2/49,  ±4,  ±4/7,  ±4/49. 

To  complete  our  proof,  all  we  need  to  do  is  substitute  these  18  can¬ 
didates  into  the  equation  49x4  —  56x2  ±4  =  0.  This  prospect  is 
so  discouraging,  however,  that  we  choose  to  find  a  more  clever  ap¬ 
proach.  In  Example  1,  we  also  showed  12  =  (4  —  7b2)2.  Now  if  b  were 
rational,  then  4  —  7fe2  would  also  be  rational  [Exercise  2.6],  so  the 
equation  12  =  x 2  would  have  a  rational  solution.  But  the  only  pos¬ 
sible  rational  solutions  to  x2  —  12  =  0  are  ±1,  ±2,  ±3,  ±4,  ±6,  ±12, 
and  these  all  can  be  eliminated  by  mentally  substituting  them  into 
the  equation.  We  conclude  4  —  7b2  cannot  be  rational,  so  b  cannot 
be  rational.  ■ 

As  a  practical  matter,  many  or  all  of  the  rational  candidates  given 
by  the  Rational  Zeros  Theorem  can  be  eliminated  by  approximating 
the  quantity  in  question.  It  is  nearly  obvious  that  the  values  in  Ex¬ 
amples  2  through  5  are  not  integers,  while  all  the  rational  candidates 
are.  The  number  b  in  Example  6  is  approximately  0.2767;  the  nearest 
rational  candidate  is  +2/7  which  is  approximately  0.2857. 

It  should  be  noted  that  not  all  irrational-looking  expressions  are 
actually  irrational.  See  Exercise  2.7. 

2.4  Remark. 

While  admiring  the  efficient  Rational  Zeros  Theorem  for  finding 
rational  zeros  of  polynomials  with  integer  coefficients,  you  might 
wonder  how  one  would  find  other  zeros  of  these  polynomials,  or  ze¬ 
ros  of  other  functions.  In  §31,  we  will  discuss  the  most  well-known 
method,  called  Newton’s  method,  and  its  cousin,  the  secant  method. 
That  discussion  can  be  read  now;  only  the  proof  of  the  theorem  uses 
material  from  §31. 


Exercises 

2.1  Show  a/3,  "\/5,  a/T,  a/24,  and  \/31  are  not  rational  numbers. 

2.2  Show  s/2,  Vb  and  -\/T3  are  not  rational  numbers. 
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2.3  Show  a/2  +  a/2  is  not  a  rational  number. 

2.4  Show  \/5  —  V3  is  not  a  rational  number. 

2.5  Show  [3  +  y/2]2^  is  not  a  rational  number. 

2.6  In  connection  with  Example  6,  discuss  why  4  —  7b2  is  rational  if  b  is 
rational. 

2.7  Show  the  following  irrational-looking  expressions  are  actually  rational 
numbers:  (a)  \/  4  +  2\/3  —  \/3,  and  (b)  \/ 6  +  4\/2  —  \/2. 

2.8  Find  all  rational  solutions  of  the  equation  x8  —  4x5  +  13a:3  —  7a:  + 1  =  0. 


§3  The  Set  R  of  Real  Numbers 

The  set  Q  is  probably  the  largest  system  of  numbers  with  which 
you  really  feel  comfortable.  There  are  some  subtleties  but  you  have 
learned  to  cope  with  them.  For  example,  Q  is  not  simply  the  set  of 
symbols  m/n,  where  m,neZ,n/  0,  since  we  regard  some  pairs  of 
different  looking  fractions  as  equal.  For  example,  -  and  |  represent 
the  same  element  of  Q.  A  rigorous  development  of  Q  based  on  Z, 
which  in  turn  is  based  on  N,  would  require  us  to  introduce  the  notion 
of  equivalence  classes.  In  this  book  we  assume  a  familiarity  with  and 
understanding  of  Q  as  an  algebraic  system.  However,  in  order  to 
clarify  exactly  what  we  need  to  know  about  Q,  we  set  down  some  of 
its  basic  axioms  and  properties. 

The  basic  algebraic  operations  in  Q  are  addition  and  multiplica¬ 
tion.  Given  a  pair  a,  b  of  rational  numbers,  the  sum  a  +  b  and  the 
product  ab  also  represent  rational  numbers.  Moreover,  the  following 
properties  hold. 

Al.  a  +  {b  +  c)  =  (a  +  b)  +  c  for  all  a,  b,  c. 

A2.  a  +  b  =  b  +  a  for  all  a,  b. 

A3,  a  +  0  =  a  for  all  a. 

A4.  For  each  a,  there  is  an  element  —a  such  that  a  +  (—a)  =  0. 

Ml.  a(bc)  =  ( ab)c  for  all  a,b,c. 

M2,  ab  =  ba  for  all  a,  b. 
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M3,  a  ■  1  =  a  for  all  a. 

M4.  For  each  a  ^  0,  there  is  an  element  a-1  such  that  aa-1  =  1. 

DL  a(b  +  c)  =  ab  +  ac  for  all  a,  b,  c. 

Properties  A1  and  Ml  are  called  the  associative  laws,  and  prop¬ 
erties  A2  and  M2  are  the  commutative  laws.  Property  DL  is  the 
distributive  law,  this  is  the  least  obvious  law  and  is  the  one  that 
justifies  “factorization”  and  “multiplying  out”  in  algebra.  A  system 
that  has  more  than  one  element  and  satisfies  these  nine  properties  is 
called  a  field.  The  basic  algebraic  properties  of  Q  can  proved  solely 
on  the  basis  of  these  field  properties.  We  will  not  pursue  this  topic 
in  any  depth,  but  we  illustrate  our  claim  by  proving  some  familiar 
properties  in  Theorem  3.1  below. 

The  set  Q  also  has  an  order  structure  <  satisfying 

Ol.  Given  a  and  b,  either  a  <  b  or  b  <  a. 

02.  If  a  <  b  and  b  <  a,  then  a  =  b. 

03.  If  a  <  b  and  b  <  c,  then  a  <  c. 

04.  If  a  <  b,  then  a  +  c  <  b  +  c. 

05.  If  a  <  b  and  0  <  c,  then  ac  <  be. 

Property  03  is  called  the  transitive  law.  This  is  the  characteristic 
property  of  an  ordering.  A  field  with  an  ordering  satisfying  properties 
01  through  05  is  called  an  ordered  field.  Most  of  the  algebraic  and 
order  properties  of  Q  can  be  established  for  an  ordered  held.  We  will 
prove  a  few  of  them  in  Theorem  3.2  below. 

The  mathematical  system  on  which  we  will  do  our  analysis  will 
be  the  set  R  of  all  real  numbers.  The  set  R  will  include  all  rational 
numbers,  all  algebraic  numbers,  ir,  e,  and  more.  It  will  be  a  set  that 
can  be  drawn  as  the  real  number  line;  see  Fig.  3.1.  That  is,  every 
real  number  will  correspond  to  a  point  on  the  number  line,  and 
every  point  on  the  number  line  will  correspond  to  a  real  number. 
In  particular,  unlike  Q,  R  will  not  have  any  “gaps.”  We  will  also 
see  that  real  numbers  have  decimal  expansions;  see  10.3  on  page  58 
and  §16.  These  remarks  help  describe  R,  but  we  certainly  have  not 
defined  R  as  a  precise  mathematical  object.  It  turns  out  that  R  can 
be  defined  entirely  in  terms  of  the  set  Q  of  rational  numbers;  we 
indicate  in  the  enrichment  §6  one  way  this  can  be  done.  But  then 
it  is  a  long  and  tedious  task  to  show  how  to  add  and  multiply  the 
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objects  defined  in  this  way  and  to  show  that  the  set  K,  with  these 
operations,  satisfies  all  the  familiar  algebraic  and  order  properties 
we  expect  to  hold  for  M.  To  develop  M  properly  from  Q  in  this  way 
and  to  develop  Q  properly  from  N  would  take  us  several  chapters. 
This  would  defeat  the  purpose  of  this  book,  which  is  to  accept  M  as 
a  mathematical  system  and  to  study  some  important  properties  of 
M  and  functions  on  M.  Nevertheless,  it  is  desirable  to  specify  exactly 
what  properties  of  M  we  are  assuming. 

Real  numbers,  i.e. ,  elements  of  K,  can  be  added  together  and 
multiplied  together.  That  is,  given  real  numbers  a  and  6,  the  sum 
a+b  and  the  product  ab  also  represent  real  numbers.  Moreover,  these 
operations  satisfy  the  field  properties  A1  through  A4,  Ml  through 
M4,  and  DL.  The  set  M  also  has  an  order  structure  <  that  satisfies 
properties  01  through  05.  Thus,  like  Q,  K  is  an  ordered  field. 

In  the  remainder  of  this  section,  we  will  obtain  some  results  for 
K  that  are  valid  in  any  ordered  field.  In  particular,  these  results 
would  be  equally  valid  if  we  restricted  our  attention  to  Q.  These 
remarks  emphasize  the  similarities  between  M  and  Q.  We  have  not 
yet  indicated  how  M  can  be  distinguished  from  Q  as  a  mathematical 
object,  although  we  have  asserted  that  M  has  no  “gaps.”  We  will 
make  this  observation  much  more  precise  in  the  next  section,  and 
then  we  will  give  a  “gap  filling”  axiom  that  finally  will  distinguish  M 
from  Q. 

3.1  Theorem. 

The  following  are  consequences  of  the  field  properties: 

(i)  a  +  c  =  b  +  c  implies  a  =  b; 

(ii)  a  ■  0  =  0  for  all  a; 

(iii)  (— a)b  =  —ab  for  all  a,  b; 

(iv)  (— a)(— b)  =  ab  for  all  a,  b; 

(v)  ac  =  be  and  c  ^  0  imply  a  =  b; 

(vi)  ab  =  0  implies  either  a  =  0  or  b  =  0; 
for  a,b,c  E  M. 
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Proof 

(i)  a  +  c  =  b  +  c  implies  (a  +  c)  +  (— c)  =  (b  +  c)  +  (— c),  so  by  Al, 
we  have  a+[c  +  (— c)]  =  b+[c+  (— c)].  By  A4,  this  reduces  to 
a  +  0  =  6  +  0,  so  a  =  6  by  A3. 

(ii)  We  use  A3  and  DL  to  obtain  a-0  =  a-(0  +  0)  =  a-  0  +  a-0, 
so0  +  a-  0  =  a-  0  +  a-0.  By  (i)  we  conclude  0  =  a  ■  0. 

(iii)  Since  a  +  (—a)  =  0,  we  have  ab  +  (—a)b  =  [a  +  (—a)]  •  b  = 
0  •  b  =  0  =  ab  +  (— ( ab )).  From  (i)  we  obtain  (~a)b  =  —(ab). 

(iv)  and  (v)  are  left  to  Exercise  3.3. 

(vi)  If  ab  =  0  and  b  ^  0,  then  0  =  6_1  -0  =  0-  b^1  =  (ab)  ■  6_1  = 
a(6fe_1)  =  a  ■  1  =  a.  ■ 


3.2  Theorem. 

The  following  are  consequences  of  the  properties  of  an  ordered  field: 

(i)  If  a,  <b,  then  —b  <  —a; 

(ii)  If  a  <  b  and  c  <  0,  then  be  <  ac; 

(iii)  7/0  <  a  and  0  <  b,  then  0  <  ab; 

(iv)  0  <  a2  for  all  a; 

(v)  0  <  1; 

(vi)  7/0  <  a,  then  0  <  a  1 ; 

(vii)  If  0  <  a  <  b,  then  0  <  b <  a-1; 
for  a,b,c  6  M. 

Note  a  <  b  means  a  <  b  and  a  b. 


Proof 

(i)  Suppose  a  <  b.  By  04  applied  to  c  =  (—a)  +  (—b),  we  have 
a  +  [(— a)  +  (— b)}  <  b  +  [(— a)  +  (— b)] .  It  follows  that  — b  <  —a. 

(ii)  If  a  <  b  and  c  <  0,  then  0  <  — c  by  (i).  Now  by  05  we  have 
a(—c)  <  b(—c),  i.e. ,  —ac  <  —be.  From  (i)  again,  we  see  be  <  ac. 

(iii)  If  we  put  a  =  0  in  property  05,  we  obtain:  0  <  b  and  0  <  c 
imply  0  <  be.  Except  for  notation,  this  is  exactly  assertion 

(iii). 

(iv)  For  any  a,  either  a  >  0  or  a  <  0  by  01.  If  a  >  0,  then  a2  >  0 
by  (iii).  If  a  <  0,  then  we  have  —a  >  0  by  (i),  so  (—a)2  >  0, 
i.e.,  a2  >  0. 

(v)  Is  left  to  Exercise  3.4. 
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(vi)  Suppose  0  <  a  but  0  <  a-1  fails.  Then  we  must  have  a-1  <  0 
and  0  <  —a~l.  Now  by  (iii)  0  <  a(— a-1)  =  —1,  so  that  1  <  0, 
contrary  to  (v). 

(vii)  Is  left  to  Exercise  3.4.  ■ 

Another  important  notion  that  should  be  familiar  is  that  of 
absolute  value. 

3.3  Definition. 

We  define 

\a\  =  a  if  a  >  0  and  |a|  =  —a  if  a  <  0. 

|a|  is  called  the  absolute  value  of  a. 

Intuitively,  the  absolute  value  of  a  represents  the  distance  be¬ 
tween  0  and  a,  but  in  fact  we  will  define  the  idea  of  “distance”  in 
terms  of  the  “absolute  value,”  which  in  turn  was  defined  in  terms  of 
the  ordering. 

3.4  Definition. 

For  numbers  a  and  b  we  define  dist(a,  b )  =  \a— b\\  dist(a,  b)  represents 
the  distance  between  a  and  b. 

The  basic  properties  of  the  absolute  value  are  given  in  the  next 
theorem. 

3.5  Theorem. 

(i)  |a|  >  0  for  all  a£l. 

(ii)  \ab\  =  |a|  •  \b\  for  all  a,  b  €  M. 

(iii)  |a  +  b\  <  |a|  +  \b\  for  all  a,  b  €  M. 

Proof 

(i)  is  obvious  from  the  definition.  [The  word  “obvious”  as  used 
here  signifies  the  reader  should  be  able  to  quickly  see  why  the 
result  is  true.  Certainly  if  a  >  0,  then  |a|  =  a  >  0,  while  a  <  0 
implies  |a|  =  —  a  >  0.  We  will  use  expressions  like  “obviously” 
and  “clearly”  in  place  of  very  simple  arguments,  but  we  will 
not  use  these  terms  to  obscure  subtle  points.] 
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(ii)  There  are  four  easy  cases  here.  If  a  >  0  and  b  >  0,  then  ab  >  0, 
so  |a|  •  \b\  =  ab  =  \ab\.  If  a  <  0  and  b  <  0,  then  —a  >  0,  —  b  >  0 
and  (— a)(— b)  >  0  so  that  |a|  •  |fe|  =  (—a)(—b)  =  ab  =  |a6|. 
If  a  >  0  and  b  <  0,  then  —b  >  0  and  a(—b)  >  0  so  that 
|a|  ■  \b\  =  a(—b)  =  ~{ab)  =  \ab\.  If  a  <  0  and  b  >  0,  then 
—a  >  0  and  (— a)b  >  0  so  that  |a|  •  |6|  =  (— a)6  =  — ab  =  \ab\. 
(iii)  The  inequalities  — |a|  <  a  <  |a|  are  obvious,  since  either 
a  =  |a|  or  else  a  =  — |a|.  Similarly  —\b\  <  b  <  |6|.  Now  four 
applications  of  04  yield 

—  \a\  +  (— 16|)  <  a  +  b  <  |o|  +  b  <  |a|  +  |6| 

so  that 

—  (|a|  +  |6|)  <  a  +  b  <  |a|  +  |6|. 

This  tells  us  a  +  b  <  |o|  +  \b\  and  also  —(a  +  b)  <  |a|  +  |6|. 
Since  |a  +  b\  is  equal  to  either  a  +  b  or  —  (a  +  b),  we  conclude 
|a  +  b\  <  |a|  +  |6|.  ■ 

3.6  Corollary. 

dist(a,  c)  <  dist(a,  b )  +  dist (6,  c)  for  all  a,b,c  €  M. 

Proof 

We  can  apply  inequality  (iii)  of  Theorem  3.5  to  a  —  b  and  b  —  c  to 
obtain  | (a  —  b)  +  (b  —  c)|  <  \a  —  b\  +  \b  —  c\  or  dist(a,c)  =  \a  —  c\  < 
\a  —  b\  +  \b  —  c\  <  dist(a,  b)  +  dist (6,  c).  ■ 

The  inequality  in  Corollary  3.6  is  very  closely  related  to  an 
inequality  concerning  points  a,  b,  c  in  the  plane,  and  the  latter  in¬ 
equality  can  be  interpreted  as  a  statement  about  triangles:  the  length 
of  a  side  of  a  triangle  is  less  than  or  equal  to  the  sum  of  the  lengths 
of  the  other  two  sides.  See  Fig.  3.2.  For  this  reason,  the  inequality 
in  Corollary  3.6  and  its  close  relative  (iii)  in  Theorem  3.5  are  often 
called  the  Triangle  Inequality. 

3.7  Triangle  Inequality. 

|a  +  b\  <  |a|  +  \b\  for  all  a,  b. 

A  useful  variant  of  the  triangle  inequality  is  given  in  Exer¬ 
cise  3.5(b). 
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Exercises 

3.1  (a)  Which  of  the  properties  A1-A4,  M1-M4,  DL,  01-05  fail  for  N? 
(b)  Which  of  these  properties  fail  for  Z? 

3.2  (a)  The  commutative  law  A2  was  used  in  the  proof  of  (ii)  in 

Theorem  3.1.  Where? 

(b)  The  commutative  law  A2  was  also  used  in  the  proof  of  (iii)  in 
Theorem  3.1.  Where? 

3.3  Prove  (iv)  and  (v)  of  Theorem  3.1. 

3.4  Prove  (v)  and  (vii)  of  Theorem  3.2. 

3.5  (a)  Show  |&|  <  a  if  and  only  if  —a  <  b  <  a. 

(b)  Prove  ||a|  —  |6||  <  | a  —  6|  for  all  a,  b  €  R. 

3.6  (a)  Prove  |a  +  b  +  c\  <  |a|  +  |&|  +  |c|  for  all  a,  b,  c  £  R.  Hint:  Apply  the 

triangle  inequality  twice.  Do  not  consider  eight  cases. 

(b)  Use  induction  to  prove 

1 0-1  +  0,2  +  •  •  •  +  an\  <  | Ot-1 1  +  1 0.2  I  +  •  •  '  +  \&n\ 

for  n  numbers  a\,  <22, . . . ,  an. 

3.7  (a)  Show  |&|  <  a  if  and  only  if  —a  <  b  <  a. 

(b)  Show  \a  —  b\  <  c  if  and  only  if  6  —  c  <  a  <  b  +  c. 

(c)  Show  \a  —  b\  <  c  if  and  only  if  b  —  c  <  a  <  b  +  c. 

3.8  Let  a,  b  €  R.  Show  if  a  <  b\  for  every  b\  >  b ,  then  a  <  b. 
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§4  The  Completeness  Axiom 

In  this  section  we  give  the  completeness  axiom  for  M.  This  is  the 
axiom  that  will  assure  us  M  has  no  “gaps.”  It  has  far-reaching  conse¬ 
quences  and  almost  every  significant  result  in  this  book  relies  on  it. 
Most  theorems  in  this  book  would  be  false  if  we  restricted  our  world 
of  numbers  to  the  set  Q  of  rational  numbers. 

4.1  Definition. 

Let  S  be  a  nonempty  subset  of  M. 

(a)  If  S  contains  a  largest  element  so  [that  is,  s o  belongs  to  S  and 
s  <  s0  for  all  s  £  S],  then  we  call  so  the  maximum  of  S  and 
write  so  =  max  S'. 

(b)  If  S  contains  a  smallest  element,  then  we  call  the  smallest 
element  the  minimum  of  S  and  write  it  as  min  S. 

Example  1 

(a)  Every  finite  nonempty  subset  of  M  has  a  maximum  and  a 
minimum.  Thus 

max{l,  2,  3, 4,  5}  =  5  and  min{l,  2, 3, 4, 5}  =  1, 
max{0, 7T,  — 7,  e,  3, 4/3}  =  7T  and  min{0, 7r,  — 7,  e,  3, 4/3}  =  — 7, 
max{n  £  Z  :  —4  <  n  <  100}  =  100  and 
minjra  £  Z  :  —4  <  n  <  100}  =  —3. 

(b)  Consider  real  numbers  a  and  b  where  a  <  b.  The  following 
notation  will  be  used  throughout 

[a,  b]  =  {x  £  M  :  a  <  x  <  b},  (a,  b)  =  {x  £  R  :  a  <  x  <  b}, 

[a,  b)  =  {x  £  M  :  a  <  x  <  b},  (a,  b]  =  {x  £  R  :  a  <  x  <  b}. 

[a,  6]  is  called  a  closed  interval ,  (a,  b)  is  called  an  open  interval, 
while  [a,  b)  and  (a,  b]  are  called  half-open  or  semi-open  intervals. 
Observe  max[a,  b]  =  b  and  min[a,  b]  =  a.  The  set  (a,  b)  has  no 
maximum  and  no  minimum,  since  the  endpoints  a  and  b  do  not 
belong  to  the  set.  The  set  [a,  b)  has  no  maximum,  but  a  is  its 
minimum. 

(c)  The  sets  Z  and  Q  have  no  maximum  or  minimum.  The  set  N 
has  no  maximum,  but  minN  =  1. 
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(d)  The  set  (r  E  Q  :  0  <  r  <  y/2}  has  a  minimum,  namely  0,  but 
no  maximum.  This  is  because  y/2  does  not  belong  to  the  set, 
but  there  are  rationals  in  the  set  arbitrarily  close  to  \/2. 

(e)  Consider  the  set  :  n  E  N}.  This  is  shorthand  for  the 

set 

{l-1,2,3-1,4,5-1,6,7-1,...}  =  {l,2,i,4,i,6,i,...}. 

The  set  has  no  maximum  and  no  minimum.  □ 

4.2  Definition. 

Let  S  be  a  nonempty  subset  of  K. 

(a)  If  a  real  number  M  satisfies  s  <  M  for  all  s  E  S,  then  M  is 
called  an  upper  bound  of  S  and  the  set  S  is  said  to  be  bounded 
above. 

(b)  If  a  real  number  m  satisfies  m  <  s  for  all  s  E  S,  then  m  is 
called  a  lower  bound  of  S  and  the  set  S  is  said  to  be  bounded 
below. 

(c)  The  set  S  is  said  to  be  bounded  if  it  is  bounded  above  and 
bounded  below.  Thus  S  is  bounded  if  there  exist  real  numbers 
m  and  M  such  that  S  C  [m,  M]. 

Example  2 

(a)  The  maximum  of  a  set  is  always  an  upper  bound  for  the  set. 
Likewise,  the  minimum  of  a  set  is  always  a  lower  bound  for  the 
set. 

(b)  Consider  a,  b  in  M,  a  <  b.  The  number  b  is  an  upper  bound  for 
each  of  the  sets  [a,  b],  (a,  6),  [a,  b),  ( a,b\ .  Every  number  larger 
than  b  is  also  an  upper  bound  for  each  of  these  sets,  but  b  is 
the  smallest  or  least  upper  bound. 

(c)  None  of  the  sets  Z,  Q  and  N  is  bounded  above.  The  set  N  is 
bounded  below;  1  is  a  lower  bound  for  N  and  so  is  any  number 
less  than  1.  In  fact,  1  is  the  largest  or  greatest  lower  bound. 

(d)  Any  nonpositive  real  number  is  a  lower  bound  for  {r  E  Q  : 
0  <  r  <  y/2}  and  0  is  the  set’s  greatest  lower  bound.  The  least 
upper  bound  is  \/2. 

(e)  The  set  :  n  E  N}  is  not  bounded  above.  Among  its 

many  lower  bounds,  0  is  the  greatest  lower  bound.  □ 
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We  now  formalize  two  notions  that  have  already  appeared  in 
Example  2. 

4.3  Definition. 

Let  S'  be  a  nonempty  subset  of  M. 

(a)  If  S  is  bounded  above  and  S  has  a  least  upper  bound,  then  we 
will  call  it  the  supremum  of  S  and  denote  it  by  sup  S. 

(b)  If  S  is  bounded  below  and  S  has  a  greatest  lower  bound,  then 
we  will  call  it  the  infimum  of  S  and  denote  it  by  inf  S. 

Note  that,  unlike  maxS  and  minS,  supS  and  inf  S  need  not 
belong  to  S.  Note  also  that  a  set  can  have  at  most  one  maximum, 
minimum,  supremum  and  infimum.  Sometimes  the  expressions  “least 
upper  bound”  and  “greatest  lower  bound”  are  used  instead  of  the 
Latin  “supremum”  and  “infimum”  and  sometimes  sup  S  is  written 
lub  S  and  inf  S  is  written  gib  S.  We  have  chosen  the  Latin  termi¬ 
nology  for  a  good  reason:  We  will  be  studying  the  notions  “lim  sup” 
and  “lim  inf”  and  this  notation  is  completely  standard;  no  one  writes 
“lim  lub”  for  instance. 

Observe  that  if  S  is  bounded  above,  then  M  =  sup  S  if  and  only 
if  (i)  s  <  M  for  all  s  6  S,  and  (ii)  whenever  M\  <  M ,  there  exists 
si  6  5  such  that  si  >  M\. 

Example  3 

(a)  If  a  set  S  has  a  maximum,  then  max  S’  =  sup  S'.  A  similar 
remark  applies  to  sets  that  have  infimums. 

(b)  If  a,  b  £  M  and  a  <  b,  then 

sup[a,  b]  =  sup(a,  b)  =  sup[a,  b)  =  sup(a,  b]  =  b. 

(c)  As  noted  in  Example  2,  we  have  infN  =  1. 

(d)  IfA  =  {r£(Q>:0<r<  \/2};  then  sup  A  =  \/2  and  inf  A  =  0. 

(e)  We  have  inf{n^-1^  :  n  €  N}  =  0.  □ 

Example  4 

(a)  The  set  A  =  :  n  £  N  and  n  >  3}  is  bounded  above  and 

bounded  below.  It  has  a  maximum,  namely  r:;  but  it  has  no 
minimum.  In  fact,  sup(A)  =  g  and  inf  (A)  =  0. 
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(b)  The  set  B  =  {r  £  Q  :  r3  <  7}  is  bounded  above,  by  2  for 
example.  It  does  not  have  a  maximum,  because  r3  ^  7  for  all 
r  E  Q,  by  the  Rational  Zeros  Theorem  2.2.  However,  sup(-B)  = 
y/l.  The  set  B  is  not  bounded  below;  if  this  isn’t  obvious,  think 
about  the  graph  of  y  =  x3.  Clearly  B  has  no  minimum.  Starting 
with  the  next  section,  we  would  write  inf (2?)  =  — oo. 

(c)  The  set  C  =  {m  +  ny/ 2  :  m,n  6  Z}  isn’t  bounded  above  or 
below,  so  it  has  no  maximum  or  minimum.  We  could  write 
sup(C')  =  Too  and  inf(C)  =  — oo. 

(d)  The  set  D  =  {x  £  M  :  x2  <  10}  is  the  open  interval 

(— %/ 10,  vTo).  Thus  it  is  bounded  above  and  below,  but  it 
has  no  maximum  or  minimum.  However,  inf (H)  =  —  y/lO  and 
sup  (D)  =  y/10.  □ 


Note  that,  in  Examples  2-4,  every  set  S  that  is  bounded  above 
possesses  a  least  upper  bound,  i.e. ,  sup  S  exists.  This  is  not  an  acci¬ 
dent.  Otherwise  there  would  be  a  “gap”  between  the  set  S  and  the 
set  of  its  upper  bounds. 


4.4  Completeness  Axiom. 

Every  nonempty  subset  S  of  M  that  is  bounded  above  has  a  least  upper 
bound.  In  other  words,  sup  S  exists  and  is  a  real  number. 


The  completeness  axiom  for  Q  would  assert  that  every  nonempty 
subset  of  Q,  that  is  bounded  above  by  some  rational  number,  has  a 
least  upper  bound  that  is  a  rational  number.  The  set  A  =  {r  E  Q  : 
0  <  r  <  y/2}  is  a  set  of  rational  numbers  and  it  is  bounded  above  by 
some  rational  numbers  [3/2  for  example],  but  A  has  no  least  upper 
bound  that  is  a  rational  number.  Thus  the  completeness  axiom  does 
not  hold  for  Q!  Incidentally,  the  set  A  can  be  described  entirely  in 
terms  of  rationals:  A  =  {r£Q:0<r  and  r2  <  2}. 

The  completeness  axiom  for  sets  bounded  below  comes  free. 


4.5  Corollary. 

Every  nonempty  subset  5  o/l  that  is  bounded  below  has  a  greatest 
lower  bound  inf  S. 
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The  set  S 
sup  (  — S) 


—m 

The  set  ~S 


FIGURE  4.1 


Proof 

Let  —S'  be  the  set  {— s  :  s  G  S};  —  S  consists  of  the  negatives  of  the 
numbers  in  S.  Since  S  is  bounded  below  there  is  an  m  in  M  such 
that  m  <  s  for  all  s  G  S.  This  implies  —  m  >  —s  for  all  s  G  S, 
so  —  mn  >  u  for  all  u  in  the  set  —  S.  Thus  —  S  is  bounded  above  by 
—m.  The  Completeness  Axiom  4.4  applies  to  — S,  so  sup(— S)  exists. 
Figure  4.1  suggests  we  prove  inf  S  =  —  sup(— S). 

Let  so  =  sup  (—5);  we  need  to  prove 

—  so  <  s  for  all  sGS,  (1) 

and 

if  t  <  s  for  all  sGS,  then  t  <  — so-  (2) 

The  inequality  (1)  will  show  — so  is  a  lower  bound  for  S,  while  (2) 
will  show  —so  is  the  greatest  lower  bound,  that  is,  —  so  =  inf  S.  We 
leave  the  proofs  of  (1)  and  (2)  to  Exercise  4.9.  ■ 

It  is  useful  to  know: 

if  a  >  0,  then  —  <  a  for  some  positive  integer  n,  (*) 

n 

and 

if  b  >  0,  then  b  <  n  for  some  positive  integer  n.  (**) 

These  assertions  are  not  as  obvious  as  they  may  appear.  If  fact,  there 
exist  ordered  fields  that  do  not  have  these  properties.  In  other  words, 
there  exists  a  mathematical  system  satisfying  all  the  properties  Al- 
A4,  M1-M4,  DL  and  01-05  in  §3  and  yet  possessing  elements  a  >  0 
and  b  >  0  such  that  a  <l/n  and  n  <  b  for  all  n.  On  the  other  hand, 
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such  strange  elements  cannot  exist  in  K  or  Q.  We  next  prove  this;  in 
view  of  the  previous  remarks  we  must  expect  to  use  the  Completeness 
Axiom. 

4.6  Archimedean  Property. 

If  a  >  0  and  b  >  0  ,  then  for  some  positive  integer  n,  we  have  na  >  b. 

This  tells  us  that,  even  if  a  is  quite  small  and  b  is  quite  large, 
some  integer  multiple  of  a  will  exceed  b.  Or,  to  quote  [4],  given  enough 
time,  one  can  empty  a  large  bathtub  with  a  small  spoon.  [Note  that 
if  we  set  b  =  1,  we  obtain  assertion  (*),  and  if  we  set  a  =  1,  we 
obtain  assertion  (**).] 

Proof 

Assume  the  Archimedean  property  fails.  Then  there  exist  a  >  0  and 
b  >  0  such  that  na  <  b  for  all  n  E  N.  In  particular,  b  is  an  upper 
bound  for  the  set  S  =  {na  :  n  E  N}.  Let  so  =  sup  S';  this  is  where  we 
are  using  the  completeness  axiom.  Since  a  >  0,  we  have  so  <  so  +  a> 
so  so  —  fl  <  so-  [To  be  precise,  we  obtain  so  <  so  +  a  and  so  —  a  <  so 
by  property  04  and  the  fact  that  a  +  (—a)  =  0.  Then  we  conclude 
so  —  a  <  so  since  so  —  a  =  so  implies  a  =  0  by  Theorem  3.1  (i) .]  Since 
so  is  the  least  upper  bound  for  S,  so  —  a  cannot  be  an  upper  bound 
for  S.  It  follows  that  so  —  a  <  n^a  for  some  no  E  N.  This  implies 
so  <  (n0  +  l)a.  Since  (no  +  l)a  is  in  S,  so  is  not  an  upper  bound 
for  S  and  we  have  reached  a  contradiction.  Our  assumption  that  the 
Archimedean  property  fails  was  wrong.  ■ 

We  give  one  more  result  that  seems  obvious  from  our  experi¬ 
ence  with  the  real  number  line,  but  which  cannot  be  proved  for  an 
arbitrary  ordered  field. 

4.7  Denseness  of  Q. 

If  a,  b  E  M  and  a  <  b,  then  there  is  a  rational  r  E  Q  such  that 
a  <  r  <  b. 

Proof 

We  need  to  show  a  <  ^  <  b  for  some  integers  m  and  n  where  n  >  0, 
and  thus  we  need 


an  <  m  <  bn. 


(1) 
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Since  b  —  a  >  0,  the  Archimedean  property  shows  there  exists  an 
n  €  N  such  that 

n{b  —  a)  >  1,  and  hence  bn  —  an  >  1.  (2) 

From  this,  it  is  fairly  evident  that  there  is  an  integer  m  between  an 
and  bn,  so  that  (1)  holds.  However,  the  proof  that  such  an  m  exists  is 
a  little  delicate.  We  argue  as  follows.  By  the  Archimedean  property 
again,  there  exists  an  integer  k  >  max{|an|,  |6n|},  so  that 

— k  <  an  <  bn  <  k. 

Then  the  sets  K  =  {j  £  Z  :  —k  <  j  <  k}  and  {j  6  K  :  an  <  j} 
are  finite,  and  they  are  nonempty,  since  they  both  contain  k.  Let 
m  =  minjj  £  K  :  an  <  j}.  Then  — k  <  an  <  m.  Since  m  >  —k,  we 
have  m  —  1  in  K ,  so  the  inequality  an  <  m  —  1  is  false  by  our  choice 
of  m.  Thus  m  —  1  <  an  and,  using  (2),  we  have  m  <  an  +  1  <  bn. 
Since  an  <  m  <  bn,  (1)  holds.  ■ 


Exercises 


4.1  For  each  set  below  that  is  bounded  above,  list  three  upper  bounds  for 
the  set.2  Otherwise  write  “NOT  BOUNDED  ABOVE”  or  “NBA.” 


(a)  [0,1] 

(c)  {2,7} 

(e)  U  :  n  G  N} 

(g)  [0, 1]  U  [2, 3] 

(i)  n-=1[-i,i  +  i] 

(k)  {n  +  -  ^  :n£ff} 

(m)  {r  £  Q  :  r2  <  4} 

(o)  {x  £  K  :  x  <  0} 

(q)  {0,1,2,4,8,16} 

(s)  {  —  :  n  £  N  and  n  is  prime} 
(u)  {x2  :  x  £  R} 

(w)  {sin(^f)  :  n  £  N} 


(b)  (0,1) 

(d)  {7r,e} 

(f)  {0} 

(h)  U~=1[2n,2n  +  1] 

0)  {1  -  :  n  £  N} 

(1)  {r  £  Q  :  r  <  2} 

(n)  {r  £  Q  :  r2  <  2} 
(P)  {l,f,7T2,  10} 

(r)  n^l-J.l  +  i) 
(t)  {x  £  M  :  x3  <  8} 
(v)  {cos(^f)  :  n  £  N} 


4.2  Repeat  Exercise  4.1  for  lower  bounds. 

4.3  For  each  set  in  Exercise  4.1,  give  its  supremum  if  it  has  one.  Otherwise 
write  “NO  sup.” 


2 


An  integer  p  >  2  is  a  prime  provided  the  only  positive  factors  of  p  are  1  and  p. 
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4.4  Repeat  Exercise  4.3  for  infima  [plural  of  infimum] . 

4.5  Let  S'  be  a  nonempty  subset  of  R  that  is  bounded  above.  Prove  if 
sup  S  belongs  to  S,  then  sup  S  =  maxS.  Hint :  Your  proof  should  be 
very  short. 

4.6  Let  S  be  a  nonempty  bounded  subset  of  R. 

(a)  Prove  inf  S  <  supS.  Hint:  This  is  almost  obvious;  your  proof 
should  be  short. 

(b)  What  can  you  say  about  S  if  inf  S  =  sup  SI 

4.7  Let  S  and  T  be  nonempty  bounded  subsets  of  R. 

(a)  Prove  if  S  C  T,  then  inf  T  <  inf  S  <  supS  <  supT. 

(b)  Prove  sup(SUT)  =  maxjsupS,  supT}.  Note:  In  part  (b),  do  not 
assume  S  CT. 

4.8  Let  S  and  T  be  nonempty  subsets  of  R  with  the  following  property: 
s  <  t  for  all  s  £  S  and  t  £  T. 

(a)  Observe  S  is  bounded  above  and  T  is  bounded  below. 

(b)  Prove  sup  S  <  inf  T. 

(c)  Give  an  example  of  such  sets  S  and  T  where  S  0  T  is  nonempty. 

(d)  Give  an  example  of  sets  S  and  T  where  sup S  =  inf  T  and  S (IT 
is  the  empty  set. 

4.9  Complete  the  proof  that  inf  S  =  —  sup(— S)  in  Corollary  4.5  by 
proving  (1)  and  (2). 

4.10  Prove  that  if  a  >  0,  then  there  exists  n  £  N  such  that  -  <  a  <  n. 

7  n 

4.11  Consider  a,  b  £  R  where  a  <  b.  Use  Denseness  of  Q  4.7  to  show  there 
are  infinitely  many  rationals  between  a  and  b. 

4.12  Let  I  be  the  set  of  real  numbers  that  are  not  rational;  elements  of  I 
are  called  irrational  numbers.  Prove  if  a  <  b,  then  there  exists  x  £  I 
such  that  a  <  x  <  b.  Hint:  First  show  {r  +  y/2  :  r  £  Q}  C  I. 

4.13  Prove  the  following  are  equivalent  for  real  numbers  a,  b,  c.  [ Equivalent 
means  that  either  all  the  properties  hold  or  none  of  the  properties 
hold.] 

(i)  |a  —  6|  <  c, 

(ii)  b—  c  <  a  <  b  +  c, 
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(iii)  a  £  (b  —  c,  b  +  c). 

Hint :  Use  Exercise  3.7(b). 

4.14  Let  A  and  B  be  nonempty  bounded  subsets  of  R,  and  let  A  +  B  be 
the  set  of  all  sums  a  +  b  where  a  £  A  and  b  £  B. 

(a)  Prove  sup(T+13)  =  sup  T+sup  B.  Hint :  To  show  sup  A+sup  B  < 
sup(T  +  B),  show  that  for  each  b  £  B,  sup(T  +  B)  —  b  is  an 
upper  bound  for  A,  hence  sup  A  <  sup(T  +  B)  —  b.  Then  show 
sup(T  +  B)  —  sup  A  is  an  upper  bound  for  B. 

(b)  Prove  inf  (A  +  B)  =  inf  A  +  inf  B. 

4.15  Let  a,  b  £  R.  Show  if  a  <  b  +  4  for  all  n  £  N,  then  a  <  b.  Compare 
Exercise  3.8. 

4.16  Show  sup{r  £  Q  :  r  <  a}  =  a  for  each  a  £  R. 


§5  The  Symbols  +00  and  —  00 

The  symbols  +oo  and  — oo  are  extremely  useful  even  though  they 
are  not  real  numbers.  We  will  often  write  +oo  as  simply  oo.  We  will 
adjoin  +oo  and  — oo  to  the  set  R  and  extend  our  ordering  to  the  set 
R  U  {—00,  +00}.  Explicitly,  we  will  agree  that  — oo  <  a  <  +oo  for 
all  a  in  RU  {— oo,  oo}.  This  provides  the  set  RU  {— oo,  +00}  with  an 
ordering  that  satisfies  properties  01,  02  and  03  of  §3.  We  emphasize 
we  will  not  provide  the  set  RU  {—00,  +00}  with  any  algebraic  struc¬ 
ture.  We  may  use  the  symbols  +00  and  —00,  but  we  must  continue 
to  remember  they  do  not  represent  real  numbers.  Do  not  apply  a 
theorem  or  exercise  that  is  stated  for  real  numbers  to  the  symbols 
+00  or  —00. 

It  is  convenient  to  use  the  symbols  +00  and  —00  to  extend  the 
notation  established  in  Example  1(b)  of  §4  to  unbounded  intervals. 
For  real  numbers  a,  b  £  R,  we  adopt  the  following 

[a,  00)  =  {x  £  R  :  a  <  x},  (a,  00)  =  {x  £  R  :  a  <  x}, 

(—00,  b]  =  {x  £  R  :  x  <  6},  (—00,  b)  =  {x  £  R  :  x  <  b}. 

We  occasionally  also  write  (—00,00)  for  R.  [a,  00)  and  (—00,6]  are 
called  closed  intervals  or  unbounded  closed  intervals,  while  (a,  00)  and 
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(—00,6)  are  called  open  intervals  or  unbounded  open  intervals.  Con¬ 
sider  a  nonempty  subset  S  of  R.  Recall  that  if  S  is  bounded  above, 
then  sup  S  exists  and  represents  a  real  number  by  the  completeness 
axiom  4.4.  We  define 

sup  S  =  +oo  if  S  is  not  bounded  above. 

Likewise,  if  S  is  bounded  below,  then  inf  S  exists  and  represents  a 
real  number  [Corollary  4.5].  And  we  define 

inf  S  =  — oo  if  S  is  not  bounded  below. 

For  emphasis,  we  recapitulate: 

Let  S  be  any  nonempty  subset  of  R.  The  symbols  sup  S'  and  inf  S 
always  make  sense.  If  S  is  bounded  above,  then  sup  S  is  a  real  num¬ 
ber;  otherwise  sup  S  =  +oo.  If  S  is  bounded  below,  then  inf  S  is  a  real 
number;  otherwise  inf  S  =  — oo.  Moreover,  we  have  inf  S  <  supS. 

Example  1 

For  nonempty  bounded  subsets  A  and  B  of  R,  Exercise  4.14  asserts 

sup(A+B)  =  sup A+supB  and  inf(A+B)  =  inf A+inf B.  (1) 

We  verify  the  first  equality  is  true  even  if  A  or  B  is  unbounded,  and 
Exercise  5.7  asks  you  to  do  the  same  for  the  second  equality. 

Consider  r  6  4  +  5,  so  that  x  =  a  +  6  for  some  a  £  A  and  6  £  B. 
Then  x  =  a  +  6  <  sup  A  +  sup  B.  Since  x  is  any  element  in  A  +  B, 
sup  A  +  supB  is  an  upper  bound  for  A  +  B;  hence  sup(A  +  B)  < 
sup  A  +  sup  B.  It  remains  to  show  sup(A  +  B)  >  sup  A  +  sup  B. 

Since  the  sets  here  are  nonempty,  the  suprema  here  are  not  equal 
to  — oo,  so  we’re  not  in  danger  of  encountering  the  undefined  sum 
—oo  +  oo.  If  sup  A  +  sup  B  =  +oo,  then  at  least  one  of  the  suprema, 
say  supB,  equals  +oo.  Select  some  ao  in  A.  Then  sup(A  +  B)  > 
sup(ao  +  B)  =  ao  +  supB  =  +oo,  so  (1)  holds  in  this  case.  Otherwise 
sup  A  +  supB  is  finite.  Consider  e  >  0.  Then  there  exists  a  £  A  and 
6  £  B,  so  that  a  >  sup  A  —  |  and  6  >  sup  B  —  §.  Then  a  +  b  £  A  +  B 
and  so  sup(A  +  B)  >  a  +  6  >  sup  A  +  supB  —  e.  Since  e  >  0  is 
arbitrary,  we  conclude  sup(A  +  B)  >  sup  A  +  sup  B.  □ 

The  exercises  for  this  section  clear  up  some  loose  ends.  Most  of 
them  extend  results  in  §4  to  sets  that  are  not  necessarily  bounded. 
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5.1  Write  the  following  sets  in  interval  notation: 


(c)  {x2  :  x  £  R} 


(a)  {x  £  R  :  x  <  0} 


(b)  {x  £  R  :  x3  <  8} 
(d)  {i£l:i2<8} 


5.2  Give  the  infimum  and  suprenrum  of  each  set  listed  in  Exercise  5.1. 

5.3  Give  the  infimum  and  supremum  of  each  unbounded  set  listed  in 
Exercise  4.1. 

5.4  Let  S'  be  a  nonempty  subset  of  R,  and  let  — S  =  {— s  :  s  £  S}.  Prove 
inf  S  =  —  sup(— S).  Hint'.  For  the  case  — oo  <  inf  S,  simply  state  that 
this  was  proved  in  Exercise  4.9. 

5.5  Prove  inf  S  <  supS  for  every  nonempty  subset  of  R.  Compare 
Exercise  4.6(a). 

5.6  Let  S  and  T  be  nonempty  subsets  of  R  such  that  S  C  T.  Prove  inf  T  < 
infS  <  supS  <  supT.  Compare  Exercise  4.7(a). 

5.7  Finish  Example  1  by  verifying  the  equality  involving  infimums. 


§6  *  A  Development  of  R 

There  are  several  ways  to  give  a  careful  development  of  R  based  on  Q. 
We  will  briefly  discuss  one  of  them  and  give  suggestions  for  further 
reading  on  this  topic.  [See  the  remarks  about  enrichment  sections  in 
the  preface.] 

To  motivate  our  development  we  begin  by  observing 


a  =  sup{r  €  Q  :  r  <  a}  for  each  a£l; 


see  Exercise  4.16.  Note  the  intimate  relationship:  a  <  b  if  and  only 
if  {r  £  Q  :  r  <  a}  C  {r  £  Q  :  r  <  b}  and,  moreover,  a  =  b  if  and 
only  if  {r  £  Q  :  r  <  a}  =  {r  6  Q  :  r  <  b}.  Subsets  a  of  Q  having  the 
form  {r  €  Q  :  r  <  a}  satisfy  these  properties: 

(i)  a  ^  Q  and  a  is  not  empty, 

(ii)  If  r  £  a,  s  £  Q  and  s  <  r,  then  s  £  a, 

(iii)  a  contains  no  largest  rational. 
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Moreover,  every  subset  a  of  Q  that  satisfies  (i)-(iii)  has  the  form 
{r  €  Q  :  r  <  a}  for  some  a  E  R;  in  fact,  a  =  sup  a.  Subsets  a  of  Q 
satisfying  (i)-(iii)  are  called  Dedekind  cuts. 

The  remarks  in  the  last  paragraph  relating  real  numbers  and 
Dedekind  cuts  are  based  on  our  knowledge  of  R,  including  the  com¬ 
pleteness  axiom.  But  they  can  also  motivate  a  development  of  R 
based  solely  on  Q.  In  such  a  development  we  make  no  a  priori  as¬ 
sumptions  about  R.  We  assume  only  that  we  have  the  ordered  field 
Q  and  that  Q  satisfies  the  Archimedean  property  4.6.  A  Dedekind 
cut  is  a  subset  a  of  Q  satisfying  (i)-(iii).  The  set  R  of  real  numbers 
is  defined  as  the  space  of  all  Dedekind  cuts.  Thus  elements  of  R  are 
defined  as  certain  subsets  of  Q.  The  rational  numbers  are  identified 
with  certain  Dedekind  cuts  in  the  natural  way:  each  rational  s  cor¬ 
responds  to  the  Dedekind  cut  s*  =  {r  E  Q  :  r  <  s}.  In  this  way 
Q  is  regarded  as  a  subset  of  R,  that  is,  Q  is  identified  with  the  set 
Q*  =  (s*  :  s  €  Q}. 

The  set  R  defined  in  the  last  paragraph  is  given  an  order  structure 
as  follows:  if  a  and  (3  are  Dedekind  cuts,  then  we  define  a  <  (3  to 
signify  a  C  f3.  Properties  01,  02  and  03  in  §3  hold  for  this  ordering. 
Addition  is  defined  in  R  as  follows:  if  a  and  j3  are  Dedekind  cuts, 
then 

a  +  (3  =  {ri  +  r-2  :  n  e  a  and  r2  E  /?}. 

It  turns  out  that  a  +  f3  is  a  Dedekind  cut  [hence  in  R]  and  this  defi¬ 
nition  of  addition  satisfies  properties  A1  A4  in  §3.  Multiplication  of 
Dedekind  cuts  is  a  tedious  business  and  has  to  be  defined  first  for 
Dedekind  cuts  >0*.  For  a  naive  attempt,  see  Exercise  6.4.  After  the 
product  of  Dedekind  cuts  has  been  defined,  the  remaining  proper¬ 
ties  of  an  ordered  field  can  be  verified  for  R.  The  ordered  field  R 
constructed  in  this  manner  from  Q  is  complete:  the  completeness 
property  in  4.4  can  be  proved  rather  than  taken  as  an  axiom. 

The  real  numbers  are  developed  from  Cauchy  sequences  in  Q 
in  [31,  §5].  A  thorough  development  of  R  based  on  Peano’s  axioms 
is  given  in  [39]. 
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Exercises 

6.1  Consider  s,t  £  Q.  Show 

(a)  s  <t  if  and  only  if  s*  C  f ; 

(b)  s  =  t  if  and  only  if  s*  =  t*: 

(c)  (s  + 1)*  =  s*  +  t*.  Note  that  s*  + t*  is  a  sum  of  Dedekind  cuts. 

6.2  Show  that  if  a  and  /3  are  Dedekind  cuts,  then  so  is  a  +  {3  =  {ri  +  r2  : 

ri  €  a  and  r2  €  (3}. 

6.3  (a)  Show  a  +  0*  =  a  for  all  Dedekind  cuts  a. 

(b)  We  claimed,  without  proof,  that  addition  of  Dedekind  cuts  satis¬ 
fies  property  A4.  Thus  if  a  is  a  Dedekind  cut,  there  is  a  Dedekind 
cut  —a  such  that  a  +  (— a )  =  0*.  How  would  you  define  —a? 

6.4  Let  a  and  /3  be  Dedekind  cuts  and  define  the  “product”:  a- /3  =  {7’ir2  : 

ri  £  a  and  r2  G  /3}. 

(a)  Calculate  some  “products”  of  Dedekind  cuts  using  the  Dedekind 
cuts  0*,  1*  and  (— 1)*. 

(b)  Discuss  why  this  definition  of  “product”  is  totally  unsatisfactory 
for  defining  multiplication  in  R. 

6.5  (a)  Show  {r  S  Q  :  r3  <  2}  is  a  Dedekind  cut,  but  {r  £  Q  :  r2  <  2}  is 

not  a  Dedekind  cut. 

(b)  Does  the  Dedekind  cut  {r  £  Q  :  r3  <  2}  correspond  to  a  rational 
number  in  R? 

(c)  Show  0*  U  {r  £  Q  :  r  >  0  and  r2  <  2}  is  a  Dedekind  cut.  Does  it 
correspond  to  a  rational  number  in  R? 


Sequences 


CHAPTER 


§7  Limits  of  Sequences 

A  sequence  is  a  function  whose  domain  is  a  set  of  the  form  {n  E  Z  : 
n  >  77i};  m  is  usually  1  or  0.  Thus  a  sequence  is  a  function  that 
has  a  specified  value  for  each  integer  n  >  m.  It  is  customary  to  de¬ 
note  a  sequence  by  a  letter  such  as  s  and  to  denote  its  value  at  n 
as  sn  rather  than  s(n).  It  is  often  convenient  to  write  the  sequence 
as  (sn)™=m  or  (sm,  sm+1,sm+2,  ■  ■  ■)■  If  m  =  1  we  may  write  (sn)neN 
or  of  course  (si,  s 2,  S3, . .  .)•  Sometimes  we  will  write  (sn)  when  the 
domain  is  understood  or  when  the  results  under  discussion  do  not 
depend  on  the  specific  value  of  m.  In  this  chapter,  we  will  be  inter¬ 
ested  in  sequences  whose  range  values  are  real  numbers,  i.e. ,  each  sn 
represents  a  real  number. 

Example  1 

(a)  Consider  the  sequence  (sn)ngpj  where  sn  =  This  is  the 

sequence  Formally,  of  course,  this  is  the 

function  with  domain  N  whose  value  at  each  n  is  The  set 

n z 

of  values  is  {1.  . .}. 
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(b)  Consider  the  sequence  given  by  an  =  (—l)71  for  n  >  0,  i.e., 
(an)£T0  where  an  =  (— l)n.  Note  that  the  first  term  of  the  se¬ 
quence  is  ao  =  1  and  the  sequence  is  (1,  —1, 1,  —1, 1,  —1, 1, . .  .). 
Formally,  this  is  a  function  whose  domain  is  {0, 1,2,.. .}  and 
whose  set  of  values  is  {—1,1}. 

It  is  important  to  distinguish  between  a  sequence  and  its 
set  of  values,  since  the  validity  of  many  results  in  this  book 
depends  on  whether  we  are  working  with  a  sequence  or  a  set. 
We  will  always  use  parentheses  (  )  to  signify  a  sequence  and 
braces  {  }  to  signify  a  set.  The  sequence  given  by  an  =  (—1)™ 
has  an  infinite  number  of  terms  even  though  their  values  are 
repeated  over  and  over.  On  the  other  hand,  the  set  {(— l)n  : 
n  =  0,1,2,...}  is  exactly  the  set  {—1,1}  consisting  of  two 
numbers. 

(c)  Consider  the  sequence  cos(r^E),  n  G  N.  The  first  term  of  this 
sequence  is  cos(|)  =  cos 60°  =  ^  and  the  sequence  looks  like 

(I  _1  _i  _!  i  i  i  _I  _i  _I  I  i  I  _i  _i  ) 

The  set  of  values  is  {cos(z|L)  :  n  6  N}  =  {^,  — —1, 1}. 

(d)  If  an  =  tfn,n  G  N,  the  sequence  is  (1,  y/2,  v^3,  a^4,  . . .).  If  we 
approximate  values  to  four  decimal  places,  the  sequence  looks 
like 


(1, 1.4142, 1.4422, 1.4142, 1.3797, 1.3480, 1.3205, 1.2968, . . .). 

It  turns  out  that  aioo  is  approximately  1.0471  and  apooo  is 
approximately  1.0069. 

(e)  Consider  the  sequence  bn  =  (1  +  }  )n,  n  G  N.  This  is  the  se¬ 
quence  (2,  (|)2,  (|)3,  (|)4j  •  •  •)•  b  we  approximate  the  values  to 
four  decimal  places,  we  obtain 

(2,  2.25,  2.3704,  2.4414,  2.4883,  2.5216,  2.5465,  2.5658, . . .). 

Also  b ioo  is  approximately  2.7048  and  fegooo  is  approximately 
2.7169.  ’  □ 


The  “limit”  of  a  sequence  (sn)  is  a  real  number  that  the  values 
sn  are  close  to  for  large  values  of  n.  For  instance,  the  values  of  the 
sequence  in  Example  1(a)  are  close  to  0  for  large  n  and  the  values 
of  the  sequence  in  Example  1(d)  appear  to  be  close  to  1  for  large  n. 
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The  sequence  (an)  given  by  an  =  (—l)™  requires  some  thought.  We 
might  say  1  is  a  limit  because  in  fact  an  =  1  for  the  large  values  of  n 
that  are  even.  On  the  other  hand,  an  =  —  1  [which  is  quite  a  distance 
from  1]  for  other  large  values  of  n.  We  need  a  precise  definition  in 
order  to  decide  whether  1  is  a  limit  of  an  =  (— l)n.  It  turns  out  that 
our  definition  will  require  the  values  to  be  close  to  the  limit  value 
for  all  large  n,  so  1  will  not  be  a  limit  of  the  sequence  an  =  (— l)n. 

7.1  Definition. 

A  sequence  (sn)  of  real  numbers  is  said  to  converge  to  the  real  number 
s  provided  that 

for  each  e  >  0  there  exists  a  number  N  such  that 

n  >  N  implies  |sn  —  s|  <  e.  (1) 

If  (sn)  converges  to  s,  we  will  write  lim^^oo  sn  =  s,  or  sn  -»  s.  The 
number  s  is  called  the  limit  of  the  sequence  (sn).  A  sequence  that 
does  not  converge  to  some  real  number  is  said  to  diverge. 


Several  comments  are  in  order.  First,  in  view  of  the  Archimedean 
property,  the  number  N  in  Definition  7.1  can  be  taken  to  be  a  positive 
integer  if  we  wish.  Second,  the  symbol  e  [lower  case  Greek  epsilon] 
in  this  definition  represents  a  positive  number,  not  some  new  exotic 
number.  However,  it  is  traditional  in  mathematics  to  use  e  and  5 
[lower  case  Greek  delta]  in  situations  where  the  interesting  or  chal¬ 
lenging  values  are  the  small  positive  values.  Third,  condition  (1)  is 
an  infinite  number  of  statements,  one  for  each  positive  value  of  e. 
The  condition  states  that  to  each  e  >  0  there  corresponds  a  number 
N  with  a  certain  property,  namely  n  >  N  implies  |sn  —  s|  <  e.  The 
value  N  depends  on  the  value  e,  and  normally  N  will  have  to  be 
large  if  e  is  small.  We  illustrate  these  remarks  in  the  next  example. 


Example  2 

|  1 

Consider  the  sequence  sn  =  .  If  we  write  sn  as  and  note 

71 

-  and  -  are  very  small  for  large  n,  it  seems  reasonable  to  conclude 
liiri  sn  =  |.  In  fact,  this  reasoning  will  be  completely  valid  after  we 
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have  the  limit  theorems  in  §9: 


lim  sn  =  lim 


3  +  4 


lim  3  +  lim(i)  _  3  +  0  _  3 

lim  7  —  4  lim(4)  7-4-0  7 


However,  for  now  we  are  interested  in  analyzing  exactly  what  we 
mean  by  lim  sn  =  | .  By  Definition  7. 1 ,  lim  sn  =  |  means 


for  each 


e  >  0 
n  >  N 


there  exists  a  number 


implies 


3n+l 


7n— 4 


iV 

<  e. 


such  that 


(1) 


As  e  varies,  N  varies.  In  Example  2  of  the  next  section  we  will  show 
that,  for  this  particular  sequence,  N  can  be  taken  to  be 
Using  this  observation,  we  find  that  for  e  equal  to  1,  0.1,  0.01,  0.001, 
and  0.000001,  respectively,  N  can  be  taken  to  be  approximately  0.96, 
4.45,  39.35,  388.33,  and  387,755.67,  respectively.  Since  we  are  inter¬ 
ested  only  in  integer  values  of  n,  we  may  as  well  drop  the  fractional 


part  of  N.  Then  we  see  five  of 
by  (1)  are: 


n  >  0 

implies 

n  >  4 

implies 

n  >  39 

implies 

n  >  388 

implies 

n  >  387,755 

implies 

infinitely  many  statements  given 


3n  +  1 

3 

< 

i; 

(2) 

7n  —  4 

7 

3n  +  1 

3 

< 

0.1; 

(3) 

7n  —  4 

7 

3n  +  1 

3 

< 

0.01; 

(4) 

7n  —  4 

7 

3n  +  1 

3 

< 

0.001; 

(5) 

7n  —  4 

7 

3n  +  1 

3 

< 

0.000001. 

(6) 

7n  —  4 

7 

Table  7.1  partially  confirms  assertions  (2)  through  (6).  We  could  go 
on  and  on  with  these  numerical  illustrations,  but  it  should  be  clear 
we  need  a  more  theoretical  approach  if  we  are  going  to  prove  results 
about  limits.  □ 


Example  3 

We  return  to  the  examples  in  Example  1. 
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TABLE  7.1 


n 

„  _  3n+l 

an  7n_4 

is  approximately 

K  -  |l 

is  approximately 

2 

0.7000 

0.2714 

3 

0.5882 

0.1597 

4 

0.5417 

0.1131 

5 

0.5161 

0.0876 

6 

0.5000 

0.0714 

40 

0.4384 

0.0098 

400 

0.4295 

0.0010 

(a)  lim  \  =  0.  This  will  be  proved  in  Example  1  of  the  next 
section. 

(b)  The  sequence  (an)  where  an  =  (— l)n  does  not  converge.  Thus 
the  expression  “limon”  is  meaningless  in  this  case.  We  will 
discuss  this  example  again  in  Example  4  of  the  next  section. 

(c)  The  sequence  cos(r|I)  does  not  converge.  See  Exercise  8.7. 

(d)  The  sequence  n 1/n  appears  to  converge  to  1.  We  will  prove 
limn1//n  =  1  in  Theorem  9.7(c)  on  page  48. 

(e)  The  sequence  ( bn )  where  bn  =  (1  +  -)n  converges  to  the  number 

e  that  should  be  familiar  from  calculus.  The  limit  lim6n  and 
the  number  e  will  be  discussed  further  in  Example  6  in  §16  and 
in  §37.  Recall  e  is  approximately  2.7182818.  □ 


We  conclude  this  section  by  showing  that  limits  are  unique.  That 
is,  if  limsn  =  s  and  limsn  =  t,  then  we  must  have  s  =  t.  In  short, 
the  values  sn  cannot  be  getting  arbitrarily  close  to  different  values 
for  large  n.  To  prove  this,  consider  e  >  0.  By  the  definition  of  limit 
there  exists  N\  so  that 


n  >  Ni  implies 


e 

Sn  S  |  <  — 


and  there  exists  N2  so  that 


n  >  IV2  implies 


sn  ~  t\  < 


e 

2' 


For  n  >  max{iVi ,  IV2},  the  Triangle  Inequality  3.7  shows 

|s  —  t\  =  |(s  —  sn)  +  (sn  -  t) |  <  |s  -  sn|  +  |sn  -  t\  <  -  +  e-  =  e. 
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This  shows  |s  —  t\  <  e  for  all  e  >  0.  It  follows  that  |s  —  t\  =  0;  hence 
s  =  t. 


Exercises 

7.1  Write  out  the  first  five  terms  of  the  following  sequences. 

(a)  sn  =  3iwr  (b)  =  & 

(C  )Cn=£  (d)sin(^) 

7.2  For  each  sequence  in  Exercise  7.1,  determine  whether  it  converges.  If 
it  converges,  give  its  limit.  No  proofs  are  required. 

7.3  For  each  sequence  below,  determine  whether  it  converges  and,  if  it 


converges,  give  its  limit 

.  No  proofs  are 

required. 

(a) 

n  —  -JL- 

Un  ~  n+1 

(b) 

h  —  ™2+3 

un  —  n2_3 

(c) 

Cn  =  2~n 

(d) 

=  1  +  | 

(e) 

xn  =  73  +  (-l)n 

(f) 

Sn  =  {2)1/n 

(g) 

Vn  =  n\ 

(h) 

dn  =  (-1  )nn 

(i) 

(-1)” 

n 

(j) 

7n3+8n 

2n3—3 

(k) 

9n2  — 18 

6n+18 

(1) 

sin(T) 

(in) 

sin(n7r) 

(n) 

sin(^ft) 

(°) 

-  sin  n 

n 

(P) 

2"+1+5 

2n—7 

(q) 

3n 

n! 

(r) 

(1  +  f)2 

(s) 

4n2+3 

3n2  — 2 

(t) 

6n+ 4 

9n2+7 

7.4  Give  examples  of 

(a)  A  sequence  ( xn )  of  irrational  numbers  having  a  limit  limxn 
that  is  a  rational  number. 

(b)  A  sequence  (rn)  of  rational  numbers  having  a  limit  limrra  that 
is  an  irrational  number. 

7.5  Determine  the  following  limits.  No  proofs  are  required,  but  show  any 
relevant  algebra. 

(a)  lim  sn  where  sn  =  \/n2  +  1  —  n, 

(b)  lim(-\/n2  +  n  —  n), 

(c)  lim(v,4?r2  +  n  —  2 n). 

Hint  for  (a):  First  show  sn  =  ,  , 1 ,  ,  . 

J  y  VnJ+l+n 
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§8  A  Discussion  about  Proofs 

In  this  section  we  give  several  examples  of  proofs  using  the  definition 
of  the  limit  of  a  sequence.  With  a  little  study  and  practice,  students 
should  be  able  to  do  proofs  of  this  sort  themselves.  We  will  some¬ 
times  refer  to  a  proof  as  a  formal  proof  to  emphasize  it  is  a  rigorous 
mathematical  proof. 


Example  1 

Prove  lim  A  =  0. 

Discussion.  Our  task  is  to  consider  an  arbitrary  e  >  0  and  show 
there  exists  a  number  N  [which  will  depend  on  e]  such  that  n  >  N 
implies  |4j  —  0|  <  e.  So  we  expect  our  formal  proof  to  begin  with 
“Let  e  >  0”  and  to  end  with  something  like  “Hence  n  >  N  implies 
—  0|  <  e.”  In  between  the  proof  should  specify  an  N  and  then 
verify  N  has  the  desired  property,  namely  n  >  N  does  indeed  imply 

I  h  _  °l  <  e- 

As  is  often  the  case  with  trigonometric  identities,  we  will  initially 
work  backward  from  our  desired  conclusion,  but  in  the  formal  proof 
we  will  have  to  be  sure  our  steps  are  reversible.  In  the  present  exam¬ 
ple,  we  want  |  Aj  —  0|  <  e  and  we  want  to  know  how  big  n  must  be. 
So  we  will  operate  on  this  inequality  algebraically  and  try  to  “solve” 
for  n.  Thus  we  want  ^  <  e.  By  multiplying  both  sides  by  n2  and 
dividing  both  sides  by  e,  we  find  we  want  --  <  n2  or  <  n.  If  our 
steps  are  reversible,  we  see  n  >  -4=  implies  1-^  —  0|  <  e.  This  suggests 

V€  n 

we  put  N  =  A=. 


Formal  Proof 

Let  e  >  0.  Let  N  =  -A.  Then  n  >  N  implies  n  > 
n2  >  -  and  hence  e  >  Thus  n  >  N  implies  | 
proves  lim  ^  =  0. 


l 


which 
-0|  < 


implies 
e.  This 


Example  2 

Prove  lim  f£±i  =  f 
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Discussion.  For  each  e  >  0,  we  need  to  to  decide  how  big  n  must 
be  to  guarantee  —  ||  <  e.  Thus  we  want 


21?r  +  7  —  21n  +  12 


7(4n  -  4) 


<  e  or 


19 


7(7n  -  4) 


<  e. 


Since  7n  —  4  >  0,  we  can  drop  the  absolute  value  and  manipulate 
the  inequality  further  to  “solve”  for  n: 


—  <  7n  —  4  or 
7e 


- b  4  <  7 n  or 

7e 


19 

We 


4 

7 


<  n. 


Our  steps  are  reversible,  so  we  will  put  N  =  ^  Incidentally,  we 
could  have  chosen  N  to  be  any  number  larger  than  ^ 


Formal  Proof 


Let  e  >  0  and  let  IV  =  4^  +  7- 
hence  7n  > 

I  3n+l 
I  7n—4 


Then  n  >  N  implies  n  >  ^57  +  f, 


4,  hence  7n  —  4  >  ||,  hence 
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-  f  |  <  e.  This  proves  lim  =  3. 


7(7n— 4) 


<  e,  and  hence 


Example  3 

Prove  lim  =  4. 

n^—o 

Discussion.  For  each  e  >  0,  we  need  to  determine  how  large  n 
has  to  be  to  imply 


4n3  +  3n 
n3  —  6 


<  e 


or 


3n  +  24 
n3  —  6 


By  considering  n  >  1,  we  may  drop  the  absolute  values;  thus  we  need 
to  find  how  big  n  must  be  to  give  3'ta^3,1  <  e.  This  time  it  would  be 
very  difficult  to  “solve”  for  or  isolate  n.  Recall  we  need  to  find  some 
N  such  that  n  >  N  implies  <  e,  but  we  do  not  need  to  find 

the  least  such  N.  So  we  will  simplify  matters  by  making  estimates. 
The  idea  is  that  3n3+2,4  is  bounded  by  some  constant  times  -t-  =  \ 
for  sufficiently  large  n.  To  find  such  a  bound  we  will  find  an  upper 
bound  for  the  numerator  and  a  lower  bound  for  the  denominator. 
For  example,  since  3n  +  24  <  27 n,  it  suffices  for  us  to  get  <  e. 
To  make  the  denominator  smaller  and  yet  a  constant  multiple  of  n3, 
we  note  n3  —  6  >  \  provided  n  is  sufficiently  large;  in  fact,  all  we 
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need  is  ^  >  6  or  n3  >  12  or  n  >  2.  So  it  suffices  to  get 


<  e  or 


C.A 

^  <  e  orn  > 

n  z 


^ ,  provided  n  >  2. 


Formal  Proof  _ 

Let  e  >  0  and  let  N  =  max{2,  y  Then  n  >  N  implies  n  > 

hence  H  <  e,  hence  <  e.  Since  n  >  2,  we  have  ^  <  n3  —  6  and 
also  27 n  >  3n  +  24.  Thus  n  >  N  implies 
3n  +  24  27re  _  54 
n3  —  6  —  ^n3  n2  <  ’ 


and  hence 


4n3  +  3  n 
n3  —  6 


<  e, 


as  desired. 


Example  3  illustrates  direct  proofs  of  even  rather  simple  limits 
can  get  complicated.  With  the  limit  theorems  of  §9  we  would  just 
write 


4n3  +  3n 

=  lim 

"4+  A' 

lim 4  +  3  ■  lim(4j) 

n3  —  6 

“fe 

1 

T— 1 

_ 1 

lim  1  —  6  •  lim(^3-) 

Example  4 

Show  that  the  sequence  an  =  (— l)n  does  not  converge. 

Discussion.  We  will  assume  lim(— l)n  =  a  and  obtain  a  contra¬ 
diction.  No  matter  what  a  is,  either  1  or  —1  will  have  distance  at 
least  1  from  a.  Thus  the  inequality  |(— l)n  —  a|  <  1  will  not  hold  for 
all  large  n. 

Formal  Proof 

Assume  lim(— l)n  =  a  for  some  a  €E  M.  Letting  e  =  1  in  the  definition 
of  the  limit,  we  see  that  there  exists  N  such  that 

n>N  implies  |(— l)n  —  a\  <  1. 

By  considering  both  an  even  and  an  odd  n  >  N,  we  see  that 

1 1  —  a|  <  1  and  I  —  1  —  a\  <  1. 
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Now  by  the  Triangle  Inequality  3.7 

2  =  |1  —  (—1)|  =  |1  —  a  +  a—  (—1)|  <  |1  —  a|  +  |a  —  (— 1)|  <1  +  1  =  2. 

This  absurdity  shows  our  assumption  lim(— l)n  =  a  must  be  wrong, 
so  the  sequence  (— l)n  does  not  converge.  ■ 

Example  5 

Let  (sn)  be  a  sequence  of  nonnegative  real  numbers  and  suppose 
s  =  liiri sn.  Note  s  >  0;  see  Exercise  8.9(a).  Prove  limy's^  =  yfs. 

Discussion.  We  need  to  consider  e  >  0  and  show  there  exists  N 
such  that 


n  >  N  implies  |\/sn  —  \/i|  <  e. 


This  time  we  cannot  expect  to  obtain  N  explicitly  in  terms  of  e 
because  of  the  general  nature  of  the  problem.  But  we  can  hope  to 
show  such  N  exists.  The  trick  here  is  to  violate  our  training  in  algebra 
and  “irrationalize  the  denominator” : 


yf  Sn 


V~s  = 


(y/Sn  —  yfs){yfSn  +  yfs) 
yfSn  +  y/~S 


sn  s 

y/Sn  +  y/~S 


Since  sn  — >•  s  we  will  be  able  to  make  the  numerator  small  [for  large 
n].  Unfortunately,  if  s  =  0  the  denominator  will  also  be  small.  So  we 
consider  two  cases.  If  s  >  0,  the  denominator  is  bounded  below  by 
y/s  and  our  trick  will  work: 


y/S 

so  we  will  select  N  so  that  |sn  —  s\  <  yfse  for  n  >  N .  Note  that  N 
exists,  since  we  can  apply  the  definition  of  limit  to  yfse  just  as  well 
as  to  e.  For  s  =  0,  it  can  be  shown  directly  that  lim  sn  =  0  implies 
lim  yfs^  =  0;  the  trick  of  “irrationalizing  the  denominator”  is  not 
needed  in  this  case. 


Formal  Proof 

Case  I:  s  >  0.  Let  e  >  0.  Since  lim  sn  =  s,  there  exists  N  such  that 
n  >  N  implies  |sn  —  s|  <  yfse. 
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Now  n  >  N  implies 


I y/s^~  Vs\ 


|Sn  —  s|  <  |sn  —  s|  y/se 

y/~Sn  +  yfs  yfs  y/~S 


Case  II:  s  =  0.  This  case  is  left  to  Exercise  8.3. 


Example  6 

Let  (sn)  be  a  convergent  sequence  of  real  numbers  such  that  sn  ^  0 
for  all  n  £  N  and  limsn  =  s  ^  0.  Prove  inf{|sn|  :  n  6  N}  >  0. 

Discussion.  The  idea  is  that  “most”  of  the  terms  sn  are  close  to  s 
and  hence  not  close  to  0.  More  explicitly,  “most”  of  the  terms  sn  are 
within  ||s|  of  s,  hence  most  sn  satisfy  |sn|  >  ||s|.  This  seems  clear 
from  Fig.  8.1,  but  a  formal  proof  will  use  the  triangle  inequality. 


Formal  Proof 

Let  e  =  i|s|  >  0.  Since  lim sn  =  s,  there  exists  N  in  N  so  that 


Now 


n  >  N  implies  |sn  —  s|  <  — . 


n  >  N  implies  |sn|  >  — , 


since  otherwise  the  triangle  inequality  would  imply 


—  Is  —  sn  +  sn|  <  |s  —  sn|  +  |sn|  <  — — I — —  —  | s 


2  2 


which  is  absurd.  If  we  set 


(1) 


m  =  min  <J  — |si|,  |s2|,  ■  ■  ■  ,  \sN\  }  , 


mosts„  here 
A 


-j>0 


mosti„  here 


-s<0 


FIGURE  8.1 
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then  we  clearly  have  m  >  0  and  |sn|  >  m  for  all  n  G  N  in  view  of  (1). 
Thus  infUs^l  :  n  6  N}  >  m  >  0,  as  desired.  ■ 

Formal  proofs  are  required  in  the  following  exercises. 


Exercises 

8.1  Prove  the  following: 

(a)  lim  hiT-  =  0  (b)  lirn  ^  =  0 

(c)  lim  S  =  I  (d)  lim  iSI  =  0 

8.2  Determine  the  limits  of  the  following  sequences,  and  then  prove  your 
claims. 

(a)  an  =  nJ^_1 

('r\  „  _  4n+3 

VW  '  n  ~  7n-5 

(e)  sn  =  k  sin  n 

8.3  Let  (sn)  be  a  sequence  of  nonnegative  real  numbers,  and  suppose 
limsn  =  0.  Prove  limy^  =  0.  This  will  complete  the  proof  for 
Example  5. 

8.4  Let  (tn)  be  a  bounded  sequence,  i.e. ,  there  exists  M  such  that  \tn\  <  M 
for  all  n,  and  let  (sn)  be  a  sequence  such  that  limsn  =  0.  Prove 
lim  (snt„)  =  0. 

8.5  +1 

(a)  Consider  three  sequences  (an),  (bn)  and  (sn)  such  that  an  < 
sn  <  bn  for  all  n  and  liman  =  lim6n  =  s.  Prove  lirns^  =  s. 
This  is  called  the  “squeeze  lemma.” 

(b)  Suppose  (s„)  and  (tn)  are  sequences  such  that  |sn|  <  tn  for  all 
n  and  limt„  =  0.  Prove  lims^  =  0. 

8.6  Let  (sn)  be  a  sequence  in  K. 

(a)  Prove  limsn  =  0  if  and  only  if  lim  |sn|  =0. 

(b)  Observe  that  if  sn  =  (—1)",  then  lim  |sn|  exists,  but  lims„  does 
not  exist. 

8.7  Show  the  following  sequences  do  not  converge. 

(a)  cos(^f)  (b)  sn  =  (-1  )nn 

(c)  sin(^) 


(b) 

(d) 


bn  — 


7n— 19 
3n+7 
J  _  2n+4 
—  5n+2 


1This  exercise  is  referred  to  in  several  places. 
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8.8  Prove  the  following  [see  Exercise  7.5]: 

(a)  lim[Vn2  +  1  —  n]  =  0  (b)  lim[\/n2  +  n  —  n]  =  | 

(c)  lim[\/4n2  +  n  —  2 n]  =  \ 

8.9  ic2  Let  (s„)  be  a  sequence  that  converges. 

(a)  Show  that  if  sn>  a  for  all  but  finitely  many  n,  then  lim  sn  >  a. 

(b)  Show  that  if  sn  <  b  for  all  but  Enitely  many  n,  then  limsn  <  b. 

(c)  Conclude  that  if  all  but  finitely  many  sn  belong  to  [a,  b],  then 
lims„  belongs  to  [a,  6]. 

8.10  Let  (sn)  be  a  convergent  sequence,  and  suppose  lims„  >  a.  Prove 
there  exists  a  number  N  such  that  n  >  N  implies  sn  >  a. 


§9  Limit  Theorems  for  Sequences 

In  this  section  we  prove  some  basic  results  that  are  probably  al¬ 
ready  familiar  to  the  reader.  First  we  prove  convergent  sequences 
are  bounded.  A  sequence  (sn)  of  real  numbers  is  said  to  be  bounded 
if  the  set  (sn  :  n  G  N}  is  a  bounded  set,  i.e. ,  if  there  exists  a  constant 
M  such  that  |sn|  <  M  for  all  n. 

9.1  Theorem. 

Convergent  sequences  are  bounded. 

Proof 

Let  (sn)  be  a  convergent  sequence,  and  let  s  =  lim  sn.  Applying 
Definition  7.1  with  e  =  1  we  obtain  N  in  N  so  that 

n  >  N  implies  |sn  —  s|  <  1. 

From  the  triangle  inequality  we  see  n  >  N  implies  |sn|  <  |s|  +  1. 
Define  M  =  max{|s|  +  1,  |si|,  |s2 ■  ■  ■ ,  |sjv|}-  Then  we  have  |sn|  <  M 
for  all  n  £  N,  so  (sn)  is  a  bounded  sequence.  ■ 

In  the  proof  of  Theorem  9.1  we  only  needed  to  use  property  7.1(1) 
for  a  single  value  of  e.  Our  choice  of  e  =  1  was  quite  arbitrary. 


2  This  exercise  is  referred  to  in  several  places. 
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9.2  Theorem. 

If  the  sequence  (sn)  converges  to  s  and  k  is  in  M,  then  the  sequence 
(. ksn )  converges  to  ks.  That  is,  lim(fcsn)  =  k  ■  limsn. 

Proof 

We  assume  k  ^  0,  since  this  result  is  trivial  for  k  =  0.  Let  e  >  0  and 
note  we  need  to  show  | ksn  —  ks\  <  e  for  large  n.  Since  limsn  =  s, 
there  exists  N  such  that 

n  >  N  implies  |sn  —  s|  <  777. 

\k\ 

Then 

n  >  N  implies  \ksn  —  fcs|  <  e.  _ 


9.3  Theorem. 

If  (sn)  converges  to  s  and  (tn)  converges  to  t,  then  ( sn+tn )  converges 
to  s  +  t.  That  is, 

lim(sn  +  tn)  =  lim  sn  +  lim  tn. 

Proof 

Let  e  >  0;  we  need  to  show 

|sn  +  tn  —  (s  +  t)|  <  e  for  large  n. 

We  note  |sn  +  tn  —  (s  +  t)|  <  |sn  —  s|  +  \tn  — 1\.  Since  lim  sn  =  s,  there 
exists  N\  such  that 

n>  N\  implies  |sn  —  s|  <  -. 

Likewise,  there  exists  N2  such  that 

n  >  N2  implies  \tn  —  t\  < 

Let  N  =  max{iVi,  Then  clearly 

n>N  implies  \sn+tn-(s+t)\  <  \sn-s\  +  \tn-t\<^+~  =  e. 


9.4  Theorem. 

If  (sn)  converges  to  s  and  (tn)  converges  to  t,  then  ( sntn )  converges 
to  st.  That  is, 


lim(snfn)  =  (lim  sn)(lim  tn). 
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Discussion.  The  trick  here  is  to  look  at  the  inequality 


| Sn^ri  —  | it  T  Snt  <st| 
^  | Sntn  |  T  | 


Sn|  '  | ~t |  +  |i|  '  |sn  -  S 


For  large  n,  \tn  — 1\  and  |sn— s\  are  small  and  |f|  is,  of  course,  constant. 
Fortunately,  Theorem  9.1  shows  |sn|  is  bounded,  so  we  will  be  able 
to  show  \sntn  —  snt |  is  small. 


Proof 

Let  e  >  0.  By  Theorem  9.1  there  is  a  constant  M  >  0  such  that 
| |  £  M  for  all  n.  Since  lirn  tn  =  t  there  exists  N\  such  that 

n>  N\  implies  \tn  -  i|  < 

Also,  since  limsn  =  s  there  exists  IV2  such  that 


n  >  N2  implies 


sn  -  s  < 


2(|i|  +  1) 

[We  used  instead  of  At,  because  t  could  be  0.]  Now  if  N  = 

maxjlVi,  IV2},  then  n>  N  implies 


| Sntn  —  Si |  5;  |Sn|  '  |in  ~  i|  + 


sn  s 
e 


-  M  '  2 M  +  ^  '  2(|*|  +  1) 


e  e 

<  2  +  2  =  €- 


To  handle  quotients  of  sequences,  we  first  deal  with  reciprocals. 


9.5  Lemma. 

If  (sn)  converges  to  s,  if  sn  7^  0  for  all  n,  and  if  s  7^  0,  then  (1  / sn) 
converges  to  1/s. 


Discussion.  We  begin  by  considering  the  equality 


1 

1 

s  sn 

Sn 

S 

sns 

For  large  n,  the  numerator  is  small.  The  only  possible  difficulty  would 
be  if  the  denominator  were  also  small  for  large  n.  This  difficulty  was 
solved  in  Example  6  of  §8  where  we  proved  m=inf{|sn|  :  n£N}>0. 
Thus 


1 

Sn 


1 

S 


s  —  sn 
m|s| 
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and  it  is  clear  how  our  proof  should  proceed. 

Proof 

Let  e  >  0.  By  Example  6  of  §8,  there  exists  m  >  0  such  that  |sn|  >  m 
for  all  n.  Since  lirn  sn  =  s  there  exists  N  such  that 

n  >  N  implies  |s  —  sn|  <  e  •  m|s|. 

Then  n  >  N  implies 

s  —  sn  I  I  s  —  sn  I 

- - r1  <  J — rr -  <  e- 

|sns|  m|s|  H 


1  1 

sn  s 


9.6  Theorem. 

Suppose  (sn)  converges  to  s  and  (tn)  converges  to  t.  If  s  ^  0  and 
sn  ~f~  0  for  all  n,  then  ( tn/sn )  converges  to  t/s. 

Proof 

By  Lemma  9.5,  the  sequence  (1  / sn)  converges  to  1/s,  so 

tn  1  1  t 

Inn  —  =  Inn  —  •  tn  =  —  •  t  =  - 
Sn  Sn  S  S 

by  Theorem  9.4.  ■ 

The  preceding  limit  theorems  and  a  few  standard  examples  allow 
one  to  easily  calculate  many  limits. 

9.7  Theorem  (Basic  Examples). 

(a)  limri^0O(^)  =  0  for  p  >  0. 

(b)  lim^oo  an  =  0  if  |a|  <  1. 

(c)  lim(n1/n)  =  1. 

(d)  limrwoo(a1/n)  =  1  for  a  >  0.  □ 

Proof 

(a)  Let  e  >  0  and  let  N  =  ■  Then  n  >  N  implies  np  >  - 

and  hence  e  >  Since  ^  >  0,  this  shows  n  >  N  implies 
|  —  0|  <  e.  [The  meaning  of  np  when  p  is  not  an  integer  will 

be  discussed  in  §37.] 

(b)  We  may  suppose  a/0,  because  lim,woo  an  =  0  is  obvious  for 
a  =  0.  Since  |a|  <  1.  we  can  write  |a|  =  where  b  >  0.  By 
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the  binomial  theorem  [Exercise  1.12],  (1  +  b)n  >  1  +  nb  >  nb, 
so 


an  —  0|  =  |an 


1  1 

(1  +  b)n  <  nb' 


Now  consider  e  >  0  and  let  N  =  p- .  Then  n  >  N  implies  n  >  t 
and  hence  |an  —  0|  <  4  <  e. 

(c)  Let  sn  =  (n1/,?l)  —  1  and  note  sn  >  0  for  all  n.  By  Theorem  9.3 
it  suffices  to  show  lim  sn  =  0.  Since  1  +  sn  =  (n1//n),  we  have 
n  =  (1  +  sn)n.  For  n  >  2  we  use  the  binomial  expansion  of 
(1  +  sn)n  to  conclude 


n  =  (1  +  sn)n  >  1  +  nsn  +  ^n(n  -  l)s2  >  ^n(n  -  l)s2 . 

Thus  n  >  \n(n  —  1  )s2,  so  s2  <  ~4[.  Consequently,  we  have 

sn  <  f°r  n  >  2.  A  standard  argument  now  shows 

lim  ,sn  =  0;  see  Exercise  9.7. 

(d)  First  suppose  a  >  1.  Then  for  n  >  a  we  have  1  <  a1//n  <  n 1/n. 
Since  limn1//n  =  1,  it  follows  easily  that  lim(o1/n)  =  1;  compare 
Exercise  8.5(a).  Suppose  0  <  a  <  1.  Then  ^  >  1,  so  lim^)1/”  = 
1  from  above.  Lemma  9.5  now  shows  lim(a1/n)  =  1.  ■ 


Example  1 

Prove  limsn  =  where 

n3  +  6re2  +  7 
Sn  4?r3  +  3n  —  4 


Solution 

We  have 


Sn.  — 


I  i  6  ,  _7_ 

'  n  '  n3 

4  +  4-4' 


By  Theorem  9.7(a)  we  have  lim  1  =  0  and  lim  dj 
Theorems  9.3  and  9.2  we  have 


0.  Hence  by 


1  6  7 

1  H - 1 — ^ 


n 


lirn(l)  +  6  •  lim 


+  7  •  lim 


1 

re3 


lim 


=  1. 


E)Q  2.  Sequences 


Similarly,  we  have 


lim 


.  3  4 

4  H — 7T - 5- 


r 


Hence  Theorem  9.6  implies  limsn  = 


=  4. 


□ 


Example  2 

Find  lim  n~5 


n2+7 ' 


□ 


Solution 

Let  We  can  write  sr 

does  not  converge.  So  we  write 


1—  — 

as  — but  then  the  denominator 

ra+  — 


Sn  — 


5 


1+4 

1  n  ^ 


Now  lim(l-  —  Jj-)  =  0  by  Theorems  9.7(a),  9.3  and  9.2.  Likewise 
lim(l  +  ^r)  =  1,  so  Theorem  9.6  implies  lim sn  =  'j  =  0.  □ 


Example  3 


Find  lim 


n2+ 3 
n+ 1  ' 


□ 


Solution 

We  can  write  as 


n  +  - 

n 

l  +  h 


or 


i  +  4 

nz 

i  +  4' 

n  nz 


Both  fractions  lead  to  problems:  either  the  numerator  does  not  con¬ 
verge  or  else  the  denominator  converges  to  0.  It  turns  out  y4p  does 

not  converge  and  the  symbol  lim  nnt\  is  undefined,  at  least  for  the 
present;  see  Example  6.  The  reader  may  have  the  urge  to  use  the  sym¬ 
bol  +oo  here.  Our  next  task  is  to  make  such  use  of  the  symbol  +oo 
legitimate.  For  a  sequence  (sn),  lim  -sn  =  +oo  will  signify  that  the 
terms  sn  are  eventually  all  large.  Here  is  the  precise  definition.  □ 


9.8  Definition. 

For  a  sequence  (sn),  we  write  lim  sn  =  +oo  provided 
for  each  M  >  0  there  is  a  number  N  such  that 
n  >  N  implies  sn  >  M. 
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In  this  case  we  say  the  sequence  diverges  to  +oo. 

Similarly,  we  write  limsn  =  — oo  provided 
for  each  M  <  0  there  is  a  number  N  such  that 
n  >  N  implies  sn  <  M. 

Henceforth  we  will  say  (sn)  has  a  limit  or  the  limit  exists  pro¬ 
vided  (sn)  converges  or  diverges  to  +oo  or  diverges  to  — oo.  In  the 
definition  of  lim  sn  =  +oo  the  challenging  values  of  M  are  large  pos¬ 
itive  numbers:  the  larger  M  is  the  larger  N  will  need  to  be.  In  the 
definition  of  lim  sn  =  — oo  the  challenging  values  of  M  are  “large” 
negative  numbers  like  —10,000,000,000. 

Example  4 

We  have  limn2  =  +oo,  lim(— n)  =  — oo,  lim2n  =  +oo  and 
lim(\/n  +  7)  =  Too.  Of  course,  many  sequences  do  not  have  limits 
+oo  or  — oo  even  if  they  are  unbounded.  For  example,  the  sequences 
defined  by  sn  =  (— 1  )nn  and  tn  =  n  cos2(^-)  are  unbounded,  but 
they  do  not  diverge  to  +oo  or  — oo,  so  the  expressions  lim[(— l)nn] 
and  lim[n  cos2(^L)]  are  meaningless.  Note  tn  =  n  when  n  is  even  and 
tn  =  0  when  n  is  odd.  □ 

The  strategy  for  proofs  involving  infinite  limits  is  very  much  the 
same  as  for  finite  limits.  We  give  some  examples. 

Example  5 

Give  a  formal  proof  that  lim(-y/n  +  7)  =  +oo.  □ 

Discussion.  We  need  to  consider  an  arbitrary  M  >  0  and  show 
there  exists  N  [which  will  depend  on  M]  such  that 

n  >  N  implies  yfn  +  7  >  M. 

To  see  how  big  N  must  be  we  “solve”  for  n  in  the  inequality  y/n+ 7  > 
M.  This  inequality  holds  provided  yfn  >  M  —  7  or  n  >  (M  —  7)2. 
Thus  we  will  take  N  =  (M  —  7)2. 

Formal  Proof 

Let  M  >  0  and  let  N  =  (M  — 7)2.  Then  n  >  N  implies  n  >  (M  —  7)2, 
hence  y/n  >  M  —  7,  hence  y/n  +  7  >  M.  This  shows  lim(y/n  +  7)  = 
Too.  ■ 
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Example  6 

Give  a  formal  proof  that  lim  =  +oo;  see  Example  3.  □ 


Discussion.  Consider  M  >  0.  We  need  to  determine  how  large  n 
must  be  to  guarantee  ^  _+3  >  M.  The  idea  is  to  bound  the  fraction 

^  below  by  some  multiple  of  ^  =  n;  compare  Example  3  of  §8. 
Since  n2  +  3  >  n2  and  n  +  1  <  2 n,  we  have  ^  and  it 

suffices  to  arrange  for  -,n>  M. 


Formal  Proof 

Let  M  >  0  and  let  N  =  2 M.  Then  n  >  N  implies  \n  >  M ,  which 
implies 


n2  +  3 
n  +  1 


1 

2 


n  >  M. 


Hence  lim 


=  +oo. 


n-\- 1 


The  limit  in  Example  6  would  be  easier  to  handle  if  we  could 
apply  a  limit  theorem.  But  the  limit  Theorems  9. 2-9. 6  do  not  apply. 

WARNING.  Do  not  attempt  to  apply  the  limit  Theorems  9. 2-9. 6 
to  infinite  limits.  Use  Theorem  9.9  or  9.10  below  or  Exercises  9.9- 
9.12. 


9.9  Theorem. 

Let  (sn)  and  ( tn )  be  sequences  such  that  limsn  =  +oo  and  lim  tn  >  0 
[lirnt,,,  can  be  finite  or  +oo].  Then  lims^t^  =  +oo. 

Discussion.  Let  M  >  0.  We  need  to  show  sntn  >  M  for  large  n. 
We  have  limsn  =  +oo,  and  we  need  to  be  sure  the  fn’s  are  bounded 
away  from  0  for  large  n.  We  will  choose  a  real  number  m  so  that 
0  <  m  <  lim  tn  and  observe  tn  >  m  for  large  ?r.  Then  all  we  need  is 

>  m  for  larSe  n- 

Proof 

Let  M  >  0.  Select  a  real  number  m  so  that  0  <  m  <  lim  tn .  Whether 
lim  tn  =  +oo  or  not,  it  is  clear  there  exists  N\  such  that 


n>  N\  implies  tn  >  m; 
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see  Exercise  8.10.  Since  lims^  =  +oo,  there  exists  IV2  so  that 

Ar  .  M 

n  >  JMo  implies  sn>  — . 

m 

Put  N  =  in  ax  {TV] ,  A^}.  Then  n  >  N  implies  sntn  >  m  =  M.  ■ 

Example  7 

Use  Theorem  9.9  to  prove  lim  =  +00;  see  Example  6.  □ 

Solution 

We  observe  f  =  sntn  where  sn  =  n+  ^  and  tn  =  It 

is  easy  to  show  limsn  =  +00  and  limtn  =  1.  So  by  Theorem  9.9,  we 

have  lim  sntn  =  +00.  □ 

Here  is  another  useful  theorem. 


9.10  Theorem. 

For  a  sequence  (sn)  of  positive  real  numbers,  we  have  lim  sn  =  +00 
if  and  only  i/lim(^-)  =  0. 

Proof 

Let  (sn)  be  a  sequence  of  positive  real  numbers.  We  have  to  show 


and 


limsn  =  +00  implies 


0  implies  lim  sn  =  +oc . 


(1) 

(2) 


In  this  case  the  proofs  will  appear  very  similar,  but  the  thought 
processes  will  be  quite  different. 

To  prove  (1),  suppose  limsn  =  +00.  Let  e  >  0  and  let  M  = 
Since  limsn  =  +00,  there  exists  N  such  that  n  >  N  implies  sn  > 
M  =  Therefore  n  >  N  implies  e  >  —  >  0,  so 

G  Sn 


n  >  N  implies 


1 

- 0 

Sn 


<  e. 


That  is,  lim(^)  =  0.  This  proves  (1). 

To  prove  (2),  we  abandon  the  notation  of  the  last  paragraph  and 
begin  anew.  Suppose  lim(j-)  =  0.  Let  M  >  0  and  let  e  =  jj.  Then 
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e  >  0,  so  there  exists  N  such  that  n  >  N  implies  I  — 

Sn 

Since  sn  >  0,  we  can  write 


and  hence 


n  >  N  implies  0  <  —  <  — 

sn  M 


0|  <  e 


M' 


n  >  N  implies  M  <  sn. 


That  is,  limsn  =  +oo  and  (2)  holds. 


Exercises 


9.1  Using  the  limit  Theorems  9. 2-9. 7,  prove  the  following.  Justify  all  steps, 

(a)  lim=±!  =  l  (b)lim|^  =  i 


(c)  lim 


17n5+73n4  — 18n2+3  _  17 
23ra5  +  13n3  23 


9.2  Suppose  lima;,!  =  3,  limy„ 
following  limits: 

(a)  lim(a;„  +  yn) 


7  and  all  yn  are  nonzero.  Determine  the 

(b)  lim 


9.3  Suppose  lima„  =  a,  lim6n  =  b ,  and  sn  =  Prove  lim  sn  = 

ab2^i  carefully,  using  the  limit  theorems. 

9.4  Let  Si  =  1  and  for  n  >  1  let  s„+i  =  y/sn  +  1. 

(a)  List  the  first  four  terms  of  (s„). 

(b)  It  turns  out  that  (sn)  converges.  Assume  this  fact  and  prove 
the  limit  is  |(1  +  \/5). 

1 2  _|_2 

9.5  Let  t\  =  1  and  tn+ 1  =  -|r—  for  n  >  1.  Assume  ( tn )  converges  and  find 
the  limit. 


9.6  Let  a;i  =  1  and  xn+\  =  3a;^  for  n  >  1. 

(a)  Show  if  a  =  lim  xn ,  then  a  =  |  or  a  =  0. 

(b)  Does  lim  xn  exist?  Explain. 

(c)  Discuss  the  apparent  contradiction  between  parts  (a)  and  (b). 

9.7  Complete  the  proof  of  Theorem  9.7(c),  i.e.,  give  the  standard  argument 
needed  to  show  limsn  =  0. 
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9.8  Give  the  following  when  they  exist.  Otherwise  assert  “NOT  EXIST.” 

(a)  limn3  (b)  lim(— n3) 

(c)  lim(— ri)n  (d)  lim(l.Ol)" 

(e)  linin'1 

9.9  Suppose  there  exists  No  such  that  sn  <  tn  for  all  n>  No- 

(a)  Prove  that  if  lims^  =  +oo,  then  limf„  =  Too. 

(b)  Prove  that  if  limt„  =  — oo,  then  limsn  =  — oo. 

(c)  Prove  that  if  liinsra  and  limi„  exist,  then  limsn  <  limt„. 

9.10  (a)  Show  that  if  limsn  =  Too  and  k  >  0,  then  lim(fcs„)  =  +oo. 

(b)  Show  limsn  =  +oo  if  and  only  if  lim(— sn)  =  — oo. 

(c)  Show  that  if  limsn  =  Too  and  k  <  0,  then  lim(fcsra)  =  — oo. 

9.11  (a)  Show  that  if  lims^  =  Too  and  inf{Uj  :  n  £  N}  >  — oo,  then 

lim(s„  +  tn)  =  Too. 

(b)  Show  that  if  limsra  =  +oo  and  limt„  >  — oo,  then  1^(5,!  +tn)  = 
-f-oo. 


(c)  Show  that  if  lim  sn  =  Too  and  if  ( tn )  is  a  bounded  sequence,  then 
lim(srl  +  tn)  =  Too. 

9.12  'k3'  Assume  all  sn  ^  0  and  that  the  limit  L  =  lim  |  ^yti|  exists. 

(a)  Show  that  if  L  <  1,  then  lims„  =  0.  Hint :  Select  a  so  that 
L  <  a  <  1  and  obtain  N  so  that  |sra+i|  <  a|sn|  for  n  >  N. 
Then  show  |sra|  <  a^^SArl  for  n  >  N. 


(b)  Show  that  if  L  >  1,  then  limls^l  =  Too.  Hint:  Apply  (a)  to 
the  sequence  tn  =  see  Theorem  9.10. 

I  sri  I 


9.13  Show 


lim  an  = 

n—>  oo 


o 

l 

Too 

does  not  exist 


if  |a|  <  1 

if  a  =  1 

if  a  >  1 

if  a  <  —  1 


9.14  Let  p  >  0.  Use  Exercise  9.12  to  show 


..  a'" 

lim  —  = 

n—>  oo  TlP 


o 

Too 

does  not  exist 


if  |a|  <  1 
if  a  >  1 

if  a  <  — 1. 


Hint:  For  the  a  >  1  case,  use  Exercise  9.12(b). 


3  This  exercise  is  referred  to  in  several  places. 
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9.15  Show  linin^oo  =  0  for  all  a  €  M. 

9.16  Use  Theorems  9.9  and  9.10  or  Exercises  9.9-9.15  to  prove  the  following: 

(a)  lim  =  +0O 

(b)  lim[^-  +  (-1)"]  =  +oo 

(c)  lim[£  -  S]  = 

9.17  Give  a  formal  proof  that  limn2  =  +oo  using  only  Definition  9.8. 

9.18  (a)  Verify  1  +  a  +  a2  +  •  •  •  +  an  =  for  a/1. 

(b)  Find  limn_>00(l  +  a  +  a2  +  •  •  •  +  an )  for  |a|  <  1. 

(c)  Calculate  lim„_>00(l  +  §  +  §  +  ^  d - h^r). 

(d)  What  is  lim„_>00(l  +  a  +  o2  +  •  •  •  +  an )  for  a  >  1? 

§10  Monotone  Sequences  and  Cauchy 
Sequences 

In  this  section  we  obtain  two  theorems  [Theorems  10.2  and  10.11] 
that  will  allow  us  to  conclude  certain  sequences  converge  without 
knowing  the  limit  in  advance.  These  theorems  are  important  because 
in  practice  the  limits  are  not  usually  known  in  advance. 

10.1  Definition. 

A  sequence  (sn)  of  real  numbers  is  called  an  increasing  sequence 
if  sn  <  sn+i  for  all  n,  and  (sn)  is  called  a  decreasing  sequence  if 
sn  >  Sn+i  for  all  n.  Note  that  if  (sn)  is  increasing,  then  sn  <  sm 
whenever  n  <  m.  A  sequence  that  is  increasing  or  decreasing4  will 
be  called  a  monotone  sequence  or  a  monotonic  sequence. 

Example  1 

The  sequences  defined  by  an  =  1  —  bn  =  n3  and  cn  = 
(1  +  y)n  are  increasing  sequences,  although  this  is  not  obvious  for  the 


Tn  the  First  Edition  of  this  book,  increasing  and  decreasing  sequences  were 
referred  to  as  “nondecreasing”  and  “nonincreasing”  sequences,  respectively. 
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sequence  (cn).  The  sequence  dn  =  -^  is  decreasing.  The  sequences 
sn  =  (-l)n,  tn  =  cos(^f),  un  =  (-1  )nn  and  vn  =  are  not 

monotonic  sequences.  Also  xn  =  nl/n  is  not  monotonic,  as  can  be 
seen  by  examining  the  first  four  values;  see  Example  1(d)  on  page  33 
in  §7. 

Of  the  sequences  above,  (an),  (cn),  ( dn ),  (sn),  ( tn ),  ( vn )  and  (. xn ) 
are  bounded  sequences.  The  remaining  sequences,  (bn)  and  (un),  are 
unbounded  sequences.  □ 

10.2  Theorem. 

All  bounded  monotone  sequences  converge. 

Proof 

Let  (sn)  be  a  bounded  increasing  sequence.  Let  S  denote  the  set 
{sn  :  n  £  N},  and  let  u  =  sup  S'.  Since  S  is  bounded,  u  represents  a 
real  number.  We  show  lirn  sn  =  u.  Let  e  >  0.  Since  u  —  e  is  not  an 
upper  bound  for  S,  there  exists  N  such  that  sn  >  u  —  e.  Since  (sn) 
is  increasing,  we  have  sn  <  sn  for  all  n  >  N.  Of  course,  sn  <  u  for 
all  n,  so  n  >  N  implies  u  —  e  <  sn  <  u,  which  implies  |sn  —  u |  <  e. 
This  shows  lirn  sn  =  u. 

The  proof  for  bounded  decreasing  sequences  is  left  to 
Exercise  10.2.  ■ 

Note  the  Completeness  Axiom  4.4  is  a  vital  ingredient  in  the 
proof  of  Theorem  10.2. 

Example  2 

Consider  the  sequence  (sn)  defined  recursively  by 

s 2  i  5 

si  =  5  and  sn  =  n~1 -  for  n  >  2.  (1) 

2sn_i 

Thus  S2  =  3  and  S3  =  |  «  2.333.  First,  note  a  simple  induction 
argument  shows  sn  >  0  for  all  n.  We  will  show  limn  sn  exists  by 
showing  the  sequence  is  decreasing  and  bounded;  see  Theorem  10.2. 
In  fact,  we  will  prove  the  following  by  induction: 

y/b  <  sn+i  <  sn  <  5  for  n  >  1. 


(2) 


2.  Sequences 


Since  y/E  »  2.236,  our  computations  show  (2)  holds  for  n  <  2.  For 
the  induction  step,  assume  (2)  holds  for  some  n  >  2.  To  show  sn+2  < 
sn+ 1 ,  we  need 


sn+ 1  +  5 

2Sn+l 


<  Sn+1 


or 


®n+i  "h  5  <C  2sn+1  or  5  < 


but  this  holds  because  sn+\ 
show  sn_|_2  >  y/E,  we  need 

S'+1  +  5  >v/5 
2Sn+l 


>  y/E  by  the  assumption  (2)  for  re.  To 


or  s2+1  +  5  >  2y/Esn+1 


or  s2+1  — 2y/Esn+i+5  >  0,  which  is  true  because  s2+1— 2\/5sn+i+5  = 
(sn+i  —  \/5)2  >  0.  Thus  (2)  holds  for  re  +  1  whenever  (2)  holds  for  re. 
Hence  (2)  holds  for  all  re  by  induction.  Thus  s  =  limn  sn  exists. 

If  one  looks  at  S4  =  ~  2.238095  and  compares  with  \/E  ~ 

2.236068,  one  might  suspect  s  =  y/E.  To  verify  this,  we  apply  the 
limit  Theorems  9. 2-9. 4  and  the  fact  s  =  limn  to  the  equation 
2  •  =  s2  +  5  to  obtain  2s2  =  s2  +  5.  Thus  s2  =  5  and  s  =  y/E, 

since  the  limit  is  certainly  not  —  y/E.  □ 


10.3  Discussion  of  Decimals. 

We  have  not  given  much  attention  to  the  notion  that  real  numbers 
are  simply  decimal  expansions.  This  notion  is  substantially  correct, 
but  there  are  subtleties  to  be  faced.  For  example,  different  decimal 
expansions  can  represent  the  same  real  number.  The  somewhat  more 
abstract  developments  of  the  set  M  of  real  numbers  discussed  in  §6 
turn  out  to  be  more  satisfactory. 

We  restrict  our  attention  to  nonnegative  decimal  expansions  and 
nonnegative  real  numbers.  From  our  point  of  view,  every  nonnegative 
decimal  expansion  is  shorthand  for  the  limit  of  a  bounded  increasing 
sequence  of  real  numbers.  Suppose  we  are  given  a  decimal  expansion 
K.dic^d^di  ■  ■  •,  where  K  is  a  nonnegative  integer  and  each  dj  belongs 
to  {0,1,  2,  3, 4,  5,  6,  7,  8,  9}.  Let 


Sn 


d\  C?2 

A  +  Io  +  Io^  +  "'  + 


dn 

To™’ 


(i) 


Then  (sn)  is  an  increasing  sequence  of  real  numbers,  and  (sn)  is 
bounded  [by  K  +  1,  in  fact].  So  by  Theorem  10.2,  (sn)  converges  to 
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a  real  number  we  traditionally  write  as  K.d\d2d^d^  ■  •  -.  For  example, 
3.3333  •  •  •  represents 

/  3  3  3  \ 

lim  I  3  T  —  T  — ^  T  ■  ■  ■  T -  I  . 

oo  y  10  102  10ny 

To  calculate  this  limit,  we  borrow  the  following  fact  about  geometric 
series  from  Example  1  on  page  96  in  §14: 

lim  a(l  +  r  +  r2  +  •  •  •  +  rn )  =  — —  for  |r|  <  1;  (2) 

n— XX)  1  —  T 

see  also  Exercise  9.18.  In  our  case,  a  =  3  and  r  =  so  3.3333-  •  • 

represents  — T~  =  -y,  as  expected.  Similarly,  0.9999-  •  •  represents 
i-io 

..  /  9  9  9  \  4 

n^oo^lO  102  10 n)  1  -  T 

Thus  0.9999  •  •  •  and  1.0000  •  •  •  are  different  decimal  expansions  that 
represent  the  same  real  number! 

The  converse  of  the  preceding  discussion  also  holds.  That  is,  every 
nonnegative  real  number  x  has  at  least  one  decimal  expansion.  This 
will  be  proved,  along  with  some  related  results,  in  §16.  □ 


Unbounded  monotone  sequences  also  have  limits. 

10.4  Theorem. 

(i)  If  ( sn )  is  an  unbounded  increasing  sequence,  then  limsn  = 
Too . 

(ii)  If  ( sn )  is  an  unbounded  decreasing  sequence,  then  lim  sn  = 
— oo. 

Proof 

(i)  Let  (sn)  be  an  unbounded  increasing  sequence.  Let  M  >  0. 
Since  the  set  {sn  :  n  £  N}  is  unbounded  and  it  is  bounded 
below  by  si,  it  must  be  unbounded  above.  Hence  for  some  N 
in  N  we  have  sjv  >  M.  Clearly  n  >  N  implies  sn  >  sjv  >  M , 
so  lim  sn  =  Too. 

(ii)  The  proof  is  similar  and  is  left  to  Exercise  10.5.  ■ 
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10.5  Corollary. 

If  {sn)  is  a  monotone  sequence,  then  the  sequence  either  converges, 
diverges  to  +oo,  or  diverges  to  —  oo.  Thus  lirn  sn  is  always  meaningful 
for  monotone  sequences. 

Proof 

Apply  Theorems  10.2  and  10.4.  ■ 

Let  (sn)  be  a  bounded  sequence  in  K;  it  may  or  may  not  converge. 
It  is  apparent  from  the  definition  of  limit  in  7.1  that  the  limiting 
behavior  of  (sn)  depends  only  on  sets  of  the  form  {sn  :  n  >  N}.  For 
example,  if  limsn  exists,  clearly  it  lies  in  the  interval  [ un,vn ]  where 

un  =  inf{sn  :  n  >  N}  and  vn  =  sup{sn  :  n  >  IV}; 

see  Exercise  8.9.  As  N  increases,  the  sets  (sn  :  n  >  N}  get  smaller, 
so  we  have 


u\  <  U2  <  U3  <  ■  ■  ■  and  v\  >  V2  >  V3  >  ■  ■  ■ ; 

see  Exercise  4.7(a).  By  Theorem  10.2  the  limits  u  =  lirri/v^oo  un 
and  v  =  limyv_>.oo  vn  both  exist,  and  u  <  v  since  un  <  vn  for  all  N. 
If  limsn  exists  then,  as  noted  above,  un  <  lirn  sn  <  vn  for  all  N, 
so  we  must  have  u  <  limsn  <  v.  The  numbers  u  and  v  are  useful 
whether  lim  sn  exists  or  not  and  are  denoted  lim  inf  sn  and  lim  sup  sn, 
respectively. 

10.6  Definition. 

Let  (sn)  be  a  sequence  in  M.  We  define 

limsupsn=  lim  sup {sn  :  n  >  N\  (1) 

N^f-oo 

and 

lim  inf  sn  =  lim  inf  {sn  :  n  >  N}.  (2) 

iV— >-oo 

Note  that  in  this  definition  we  do  not  restrict  (sn)  to  be  bounded. 
However,  we  adopt  the  following  conventions.  If  (sn)  is  not  bounded 
above,  sup{sn  :  n  >  N }  =  +00  for  all  N  and  we  decree  lim  sup  sn  = 
+00.  Likewise,  if  (sn)  is  not  bounded  below,  inf{sn  :  n  >  N}  =  —00 
for  all  N  and  we  decree  lim  inf  sn  =  —00. 
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We  emphasize  lim sup sn  need  not  equal  sup{sn  :  n  G  N},  but 
lim  sup  sn  <  sup{sn  :  n  G  N}.  Some  of  the  values  sn  may  be  much 
larger  than  lim  sup  sn;  lim  sup  sn  is  the  largest  value  that  infinitely 
many  sn’s  can  get  close  to.  Similar  remarks  apply  to  lim  inf  sn.  These 
remarks  will  be  clarified  in  Theorem  11.8  and  §12,  where  we  will  give 
a  thorough  treatment  of  lim  inf’s  and  lim  sup’s.  For  now,  we  need 
a  theorem  that  shows  (sn)  has  a  limit  if  and  only  if  lim  inf  sn  = 
lim  sup  sn. 

10.7  Theorem. 

Let  (sn)  be  a  sequence  in  M. 

(i)  If  lim  sn  is  defined  [as  a  real  number,  +oo  or  —  oo],  then 
lim  inf  sn  =  lim  sn  =  lim  sup  sn . 

(ii)  //lim inf  sn  =  limsupsn;  then  limsn  is  defined  and  limsn  = 
lim  inf  sn  =  lim  sup  sn . 

Proof 

We  use  the  notation  un  =  inf{sn  :  n  >  N},  vn  =  sup{sn  :  n  >  N}, 
u  =  limiijv  =  lim  inf  sn  and  v  =  limuAr  =  lim  sup  sn. 

(i)  Suppose  lim  sn  =  +oo.  Let  M  be  a  positive  real  number.  Then 
there  is  a  positive  integer  N  so  that 

n  >  N  implies  sn  >  M. 

Then  un  =  infjs,,,  :  n  >  N}  >  M.  It  follows  that  m  >  N 
implies  um  >  M.  In  other  words,  the  sequence  (ujv)  satisfies 
the  condition  defining  lim-UAr  =  +oo,  i.e. ,  lim  inf  sn  =  +oo. 
Likewise  lim  sup  sn  =  +oo. 

The  case  limsn  =  —  oo  is  handled  in  a  similar  manner. 
Now  suppose  lim  sn  =  s  where  s  is  a  real  number.  Consider 
e  >  0.  There  exists  a  positive  integer  N  such  that  |sn  —  s|  <  e 
for  n  >  N.  Thus  sn  <  s  +  e  for  n  >  N,  so 

vn  =  sup{sn  :  n  >  N}  <  s  +  e. 

Also,  m  >  N  implies  vm  <  s+e,  so  lim  sup  sn  =  lim  vm  <  s+e. 
Since  lim  sup  sn  <  s  +  e  for  all  e  >  0,  no  matter  how  small,  we 
conclude  lim  sup  sn  <  s  =  limsn.  A  similar  argument  shows 
limsn  <  lim  inf  sn .  Since  lim  inf  sn  <  lim  sup  sn,  we  infer  all 
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three  numbers  are  equal: 

lim  inf  sn  =  lim  sn  =  limsup  sn. 

(ii)  If  lim  inf  sn  =  lim  sup  sn  =  +oo  it  is  easy  to  show  lim  sn  = 

+oo.  And  if  lim  inf  sn  =  lim  sup  sn  =  — oo  it  is  easy  to  show 

limsn  =  — oo.  We  leave  these  two  special  cases  to  the  reader. 

Suppose,  finally,  that  lim  inf  sn  =  lim  sup  sn  =  s  where  s  is 
a  real  number.  We  need  to  prove  limsn  =  s.  Let  e  >  0.  Since 
s  =  limuTv  there  exists  a  positive  integer  No  such  that 

|s  —  sup{sn  :  n  >  iVo}|  <  e. 

Thus  sup{sn  :  n  >  ./Vo}  <  s  +  e,  so 

sn  <  s  +  e  for  all  n  >  Nq.  (1) 

Similarly,  there  exists  Ni  such  that  |s  —  inf{sn  :  n  >  Ah}|  <  e, 
hence  inf{sn  :  n  >  Ah}  >  s  —  e,  hence 

sn  >  s  —  e  for  all  n  >  N\.  (2) 

From  (1)  and  (2)  we  conclude 

s  —  e  <  sn  <  s  +  e  for  n  >  maxjA'o,  Ah}, 

equivalently 

|sn  —  s|  <  e  for  n  >  maxjA^o,  N\}. 

This  proves  lim  sn  =  s  as  desired.  ■ 

If  (sn)  converges,  then  lim  inf  sn  =  lim  sup  sn  by  the  theorem  just 
proved,  so  for  large  N  the  numbers  sup{sn  :  n  >  N }  and  inf{sn  : 
n  >  N}  are  close  together.  This  implies  that  all  the  numbers  in  the 
set  {sn  :  n  >  N}  are  close  to  each  other.  This  leads  us  to  a  concept  of 
great  theoretical  importance  that  will  be  used  throughout  the  book. 

10.8  Definition. 

A  sequence  (sn)  of  real  numbers  is  called  a  Cauchy  sequence  if 

for  each  e  >  0  there  exists  a  number  N  such  that 

m,n>  N  implies  |sn  —  sm\  <  e.  (1) 


Compare  this  definition  with  Definition  7.1. 
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10.9  Lemma. 

Convergent  sequences  are  Cauchy  sequences. 

Proof 

Suppose  limsn  =  s.  The  idea  is  that,  since  the  terms  sn  are  close  to 
s  for  large  n,  they  also  must  be  close  to  each  other;  indeed 

| Sn  ~~  Sm\  =  —  S  +  S  —  Sm|  <  |sn  —  s|  +  |s  —  Sm|. 

To  be  precise,  let  e  >  0.  Then  there  exists  N  such  that 

n  >  N  implies  |sn  —  s|  <  -. 

Clearly  we  may  also  write 

m  >  N  implies  |sm  —  s|  <  -, 

so 

m,n  >  N  implies  |sn  —  sm|  <  |sn  —  s|  +  |s  —  sm|  <  —  +  -  =  e. 
Thus  (sn)  is  a  Cauchy  sequence.  ■ 


10.10  Lemma. 

Cauchy  sequences  are  bounded. 

Proof 

The  proof  is  similar  to  that  of  Theorem  9.1.  Applying  Definition  10.8 
with  e  =  1  we  obtain  N  in  N  so  that 

m,n>  N  implies  |sn  —  sm|  <  1. 

In  particular,  |sn  —  sat+i|  <  1  for  n  >  N,  so  |sn|  <  |sjv+i|  +  1  for 
n  >  N .  If  M  =  max{|sAr+i|  +  1,  |si|,  |s2 1,  ■  ■  • ,  | sat | } ,  then  |sn|  <  M 
for  all  n  G  N.  ■ 


The  next  theorem  is  very  important  because  it  shows  that  to 
verify  that  a  sequence  converges  it  suffices  to  check  it  is  a  Cauchy 
sequence,  a  property  that  does  not  involve  the  limit  itself. 

10.11  Theorem. 

A  sequence  is  a  convergent  sequence  if  and  only  if  it  is  a  Cauchy 
sequence. 
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Proof 

The  expression  “if  and  only  if”  indicates  that  we  have  two  assertions 
to  verify:  (i)  convergent  sequences  are  Cauchy  sequences,  and  (ii) 
Cauchy  sequences  are  convergent  sequences.  We  already  verified  (i) 
in  Lemma  10.9.  To  check  (ii),  consider  a  Cauchy  sequence  (sn)  and 
note  (sn)  is  bounded  by  Lemma  10.10.  By  Theorem  10.7  we  need 
only  show 

lirninf  sn  =  limsup  sn.  (1) 

Let  e  >  0.  Since  (sn)  is  a  Cauchy  sequence,  there  exists  N  so  that 

m,n>  N  implies  |sn  —  sm|  <  e. 

In  particular,  sn  <  sm  +  e  for  all  m,n  >  N.  This  shows  sm  +  e  is  an 
upper  bound  for  {sn  :  n  >  N},  so  vjy  =  sup{sn  :  n  >  N}  <  sm  +  e 
for  m  >  N .  This,  in  turn,  shows  vn  —  e  is  a  lower  bound  for  {sm  : 
m  >  IV},  so  vn  —  e  <  inf{sm  :  m  >  N}  =  un.  Thus 

lim  sup  sn  <  vn  <  un  +  e  <  lim  inf  sn  +  e. 

Since  this  holds  for  all  e  >  0,  we  have  lim  sup  sn  <  lim  inf  sn.  The 
opposite  inequality  always  holds,  so  we  have  established  (1).  ■ 

The  proof  of  Theorem  10.11  uses  Theorem  10.7,  and  Theo¬ 
rem  10.7  relies  implicitly  on  the  Completeness  Axiom  4.4,  since 
without  the  completeness  axiom  it  is  not  clear  that  lim  inf  sn  and 
lim  sup  sn  are  meaningful.  The  completeness  axiom  assures  us  that 
the  expressions  sup{sn  :  n  >  A^}  and  inf{sn  :  n  >  N}  in  Defini¬ 
tion  10.6  are  meaningful,  and  Theorem  10.2  [which  itself  relies  on 
the  completeness  axiom]  assures  us  that  the  limits  in  Definition  10.6 
also  are  meaningful. 

Exercises  on  lim  sup’s  and  lim  inf’s  appear  in  §§11  and  12. 


Exercises 


10.1  Which  of  the  following  sequences  are  increasing?  decreasing?  bounded? 

(a)  k  (b) 


(c)  n5 

(e)  (—2)” 


(d)  sin(2f ) 

(f)  # 
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10.2  Prove  Theorem  10.2  for  bounded  decreasing  sequences. 

10.3  For  a  decimal  expansion  K.d\d2d^d4  ■  ■  let  (s„)  be  defined  as  in 

Discussion  10.3.  Prove  sn  <  K  +  1  for  all  n  €  N.  Hint :  +  j§2  + 

- b  i§n  =  1  -  igs-  for  all  n. 

10.4  Discuss  why  Theorems  10.2  and  10.11  would  fail  if  we  restricted  our 
world  of  numbers  to  the  set  Q  of  rational  numbers. 

10.5  Prove  Theorem  10.4(ii). 

10.6  (a)  Let  (sn)  be  a  sequence  such  that 

|s„+i  —  sn|  <  2~n  for  all  n  £  N. 

Prove  (sn)  is  a  Cauchy  sequence  and  hence  a  convergent 
sequence. 

(b)  Is  the  result  in  (a)  true  if  we  only  assume  |s„+i  —  sn|  <  ^  for  all 
n  £  N? 

10.7  Let  S  be  a  bounded  nonempty  subset  of  K  such  that  sup  S  is  not  in  S. 
Prove  there  is  a  sequence  (s„)  of  points  in  S  such  that  lim  sn  =  sup  S. 
See  also  Exercise  11.11. 

10.8  Let  (sn)  be  an  increasing  sequence  of  positive  numbers  and  define 
<rn  =  — (si  +  S2  +  ■  ■  ■  +  sn).  Prove  (<jn)  is  an  increasing  sequence. 

10.9  Let  si  =  1  and  sn+i  =  (^y)s^  for  n  >  1. 

(a)  Find  S2,  S3  and  S4. 

(b)  Show  lim  sn  exists. 

(c)  Prove  finis™  =  0. 

10.10  Let  si  =  1  and  sn+i  =  |(s„  +  1)  for  n  >  1. 

(a)  Find  S2,  S3  and  S4. 

(b)  Use  induction  to  show  sn  >  \  for  all  n. 

(c)  Show  (sn)  is  a  decreasing  sequence. 

(d)  Show  limsn  exists  and  find  lim  sn. 

10.11  Let  t-\  =  1  and  tn+\  =  [1  —  -^2]  •  tn  for  n  >  1. 

(a)  Show  lim  tn  exists. 

(b)  What  do  you  think  limt„  is? 
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10.12  Let  t\  =  1  and  tn+ 1  =  [1  -  (ra^1)2]  •  tn  for  n  >  1. 

(a)  Show  limt„  exists. 

(b)  What  do  you  think  limtn  is? 

(c)  Use  induction  to  show  tn  =  ^Ll. 

(d)  Repeat  part  (b). 

§11  Subsequences 

11.1  Definition. 

Suppose  (sn)neN  is  a  sequence.  A  subsequence  of  this  sequence  is  a 
sequence  of  the  form  (tk)k^n  where  for  each  k  there  is  a  positive 
integer  nk  such  that 

ni<n2<  ■■■  <nk<  nk+ 1  <  •  •  •  (1) 

and 

tk  =  snk ■  (2) 

Thus  ( tk )  is  just  a  selection  of  some  [possibly  all]  of  the  sn’s  taken 
in  order. 

Here  are  some  alternative  ways  to  approach  this  concept.  Note 
that  (1)  defines  an  infinite  subset  of  N,  namely  {ni,  n2,  n^, . . .}.  Con¬ 
versely,  every  infinite  subset  of  N  can  be  described  by  (1).  Thus  a 
subsequence  of  (sn)  is  a  sequence  obtained  by  selecting,  in  order,  an 
infinite  subset  of  the  terms. 

For  a  more  precise  definition,  recall  we  can  view  the  sequence 
(sn)neN  as  a  function  s  with  domain  N;  see  §7.  For  the  subset 
{ni,  n2, 713, . . there  is  a  natural  function  a  [lower  case  Greek  sigma] 
given  by  a(k )  =  nk  for  k  £  N.  The  function  a  “selects”  an  infinite 
subset  of  N,  in  order.  The  subsequence  of  s  corresponding  to  a  is 
simply  the  composite  function  t  =  s  o  a.  That  is, 

tk  =  t{k)  =  s  o  a(k)  =  s(a(k))  =  s{nk)  =  snk  for  k  €  N.  (3) 

Thus  a  sequence  t  is  a  subsequence  of  a  sequence  s  if  and  only  if 
t  =  s  o  a  for  some  increasing  function  ct  mapping  N  into  N.  We  will 
usually  suppress  the  notation  a  and  often  suppress  the  notation  t 
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also.  Thus  the  phrase  “a  subsequence  (snk)  of  (sn)”  will  refer  to  the 
subsequence  defined  by  (1)  and  (2)  or  by  (3),  depending  upon  your 
point  of  view. 

Example  1 

Let  (sn)  be  the  sequence  defined  by  sn  =  n2(— l)n.  The  positive  terms 
of  this  sequence  comprise  a  subsequence.  In  this  case,  the  sequence 
(sn)  is 

(-1, 4,  -9, 16,  -25, 36,  -49,  64, . . .) 
and  the  subsequence  is 

(4,16,36,64,100,144,...). 

More  precisely,  the  subsequence  is  (snfc)fcgN  where  nk=2k  so 
that  snk=(2k)2{— 1)2A  =4/c2.  The  selection  function  a  is  given  by 
a(k)=2k.  □ 

Example  2 

Consider  the  sequence  an  =  sin(^)  and  its  subsequence  (ank)  of 
nonnegative  terms.  The  sequence  (an)ngN  is 

(^V3,^V3,0,-^V3,-^V3,0,iV3,iV3,0,-iV3,-iV3,0,...) 

and  the  desired  subsequence  is 

(|>/3,  |x/3, 0,0,  |x/3,  |x/3, 0,0,...). 

It  is  evident  that  n\  =  1,  ri2  =  2,  773  =  3,  774  =  6,  775  =  7,  hq  =  8, 
777  =  9,  ns  =  12,  779  =  13,  etc.  We  won’t  need  a  formula  for  77*,, 
but  here  is  one:  rik  =  k  +  2|_|j  for  k  >  1,  where  \_x\  is  the  “floor 
function,”  i.e.,  is  the  largest  integer  less  than  or  equal  to  x,  for 
x  G  M.  □ 

After  some  reflection,  the  next  theorem  will  seem  obvious,  but 
it  is  good  to  have  a  complete  proof  that  covers  all  situations.  The 
proof  is  a  little  bit  complicated,  but  we  will  apply  the  theorem  several 
times  rather  than  having  to  recreate  a  similar  proof  several  times.5 
Thus  it  is  important  to  understand  the  proof. 


5In  the  first  edition  of  this  book,  we  did  create  similar  proofs  instead. 


gg  2.  Sequences 


11.2  Theorem. 

Let  (sn)  be  a  sequence. 

(i)  Ift  is  in  M,  then  there  is  a  subsequence  of  (sn)  converging  to  t 
if  and  only  if  the  set  {n  G  N  :  |sn  —  t\  <  e}  is  infinite  for  all 
e  >  0. 

(ii)  If  the  sequence  (sn)  is  unbounded  above,  it  has  a  subsequence 
with  limit  +oo. 

(iii)  Similarly,  if  ( sn )  is  unbounded  below,  a  subsequence  has  limit 
— oo. 

In  each  case,  the  subsequence  can  be  taken  to  be  monotonic .6 

Proof 

The  forward  implications  =>  in  (i)-(iii)  are  all  easy  to  check.  For 
example,  if  lim*.  sn .  =  t  and  e  >  0,  then  all  but  hnitely  many  of  the 
nk s  are  in  {n  £  N  :  |sn  — 1\  <  e}.  We  focus  on  the  other  implications. 

(i)  First  suppose  the  set  {n  6  N  :  sn  =  t}  is  infinite.  Then 
there  are  subsequences  {snk)keN  such  that  snk  =  t  for  all 
k.  Such  subsequences  of  (sn)  are  boring  monotonic  sequences 
converging  to  t. 

Henceforth,  we  assume  {n  E  N  :  sn  =  t}  is  finite.  Then 
{n  G  N  :  0  <  |sn  —  t\  <  e}  is  inhnite  for  all  e  >  0. 

Since  these  sets  equal 

{n  €  N  :  t  —  e  <  sn  <  t}  U  {n  6  N  :  t  <  sn  <  t  +  e}, 
and  these  sets  get  smaller  as  e  — >  0,  we  have 

{n  E  N  :  t  —  e  <  sn  <  t}  is  inhnite  for  all  e>0,  (1) 

or 

{n  G  N  :  t  <  sn  <  t  +  e}  is  infinite  for  all  e  >  0;  (2) 

otherwise,  for  sufficiently  small  e  >  0,  the  sets  in  both  (1) 
and  (2)  would  be  finite. 

We  assume  (1)  holds,  and  leave  the  case  that  (2)  holds 
to  the  reader.  We  will  show  how  to  define  or  construct 


6  This  will  be  proved  easily  here,  but  is  also  a  consequence  of  the  more  general 
Theorem  11.4. 
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step-by-step  a  subsequence  (snfc)fceN  satisfying  t  —  1  <  sni  <  t 
and 


max 


SUfc-l it  k'~  Snk 


<  t  for  k  >  2. 


(3) 


Specifically,  we  will  assume  n\,  n2,  ■  ■  ■  ,  n^-i  have  been  selected 
satisfying  (3)  and  show  how  to  select  n k-  This  will  give  us  an 
infinite  increasing  sequence  (nk)k£n  and  hence  a  subsequence 
(snk)  of  (sn)  satisfying  (3).  Since  we  will  have  sn)c_1  <  snk 
for  all  k,  this  subsequence  will  be  monotonically  increasing. 
Since  (3)  also  will  imply  t—^<  snk  <  t  for  all  k,  we  will  have 
linifc  snk  =  t:  compare  Exercise  8.5(a)  on  page  44. 

A  construction  like  the  one  described  above,  and  executed 
below,  is  called  an  “inductive  definition”  or  “definition  by  in¬ 
duction,”  even  though  the  validity  of  the  process  is  not  a  direct 
consequence  of  Peano’s  axiom  N5  in  §1.' 

Here  is  the  construction.  Select  n\  so  that  t  —  1  <  sni  < 
f ;  this  is  possible  by  (1).  Suppose  ni,ri2,  ■  ■  ■  ,rik-i  have  been 
selected  so  that 


ni  <  n2  <  •  •  •  <  rik-i  (4) 

and 

max  |  snj_l ,  t  -  j  |  <  snj  <  t  for  j  =  2, . . . ,  k  -  1.  (5) 

Using  (1)  with  e  =  max{snfc  l,t—  ^},  we  can  select  nk  >  rik- i 
satisfying  (5)  for  j  =  k,  so  that  (3)  holds  for  k.  The  procedure 
defines  the  sequence  (nk)keN-  This  completes  the  proof  of  (i), 
and  is  the  crux  of  the  full  proof. 

(ii)  Let  n\  =  1.  say.  Given  n\  <  ■■■  <  rik-i,  select  nf-  so  that 
snk  >  max{snfc_1,  k}.  This  is  possible,  since  (sn)  is  unbounded 
above.  The  sequence  so  obtained  will  be  monotonic  and  have 
limit  Too.  A  similar  proof  verifies  (iii).  ■ 


7Recursive  definitions  of  sequences,  which  first  appear  in  Exercises  9. 4-9. 6,  can 
be  viewed  as  simple  examples  of  definitions  by  induction. 
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Example  3 

It  can  be  shown  that  the  set  Q  of  rational  numbers  can  be  listed 
as  a  sequence  (rn),  though  it  is  tedious  to  specify  an  exact  formula. 
Figure  11.1  suggests  such  a  listing  [with  repetitions]  where  r±  =  0, 
r2  =  1,  7-3  =  r4  =  — 7-5  =  —1,  t 6  =  —2,  r7  =  —1,  etc.  Readers 
familiar  with  some  set  theory  will  recognize  this  assertion  as  “Q 
is  countable.”  This  sequence  has  an  amazing  property:  given  any 
real  number  a  there  exists  a  subsequence  (rnk)  of  (rn)  converging  to 
a.  Since  there  are  infinitely  many  rational  numbers  in  every  interval 
(a— e,  a+e)  by  Exercise  4.11,  Theorem  11.2  shows  that  a  subsequence 
of  (rn)  converges  to  a.  □ 

Example  4 

Suppose  (sn)  is  a  sequence  of  positive  numbers  such  that  inf{sn  : 
n  G  N}  =  0.  The  sequence  (sn)  need  not  converge  or  even  be 
bounded,  but  it  has  a  subsequence  converging  monotonically  to  0.  By 
Theorem  11.2,  it  suffices  to  show  {n  G  N  :  sn  <  e}  is  infinite  for  each 
e  >  0.  Otherwise,  this  set  would  be  finite  for  some  eo  >  0.  If  the  set 
is  nonempty,  then  inf{sn  :  n  6  N}  =  min{sn  :  sn  <  e 0}  >  0,  because 
each  sn  is  positive  and  the  set  {sn  :  sn  <  eo}  is  finite.  This  contra¬ 
dicts  our  assumption  inf{sn  :  n  G  N}  =  0.  If  the  set  is  empty,  then 
inf{sn  :  n  G  N}  >  eo  >  0,  again  contrary  to  our  assumption.  □ 

The  next  theorem  is  almost  obvious. 
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FIGURE  11.1 
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11.3  Theorem. 

If  the  sequence  (sn)  converges,  then  every  subsequence  converges  to 
the  same  limit. 

Proof 

Let  (snk)  denote  a  subsequence  of  (sn).  Note  that  >  k  for  all  k. 
This  is  easy  to  prove  by  induction;  in  fact,  n\  >  1  and  n^-i  >  k  —  1 
implies  >  nk-i  >  k  —  1  and  hence  n/~  >  k. 

Let  s  =  limsn  and  let  e  >  0.  There  exists  N  so  that  n  >  N 
implies  |sn  —  s|  <  e.  Now  k  >  N  implies  n ^  >  N,  which  implies 
-  s\  <  e.  Thus 

lim  snk  =  s. 

k—too 


Our  immediate  goal  is  to  prove  the  Bolzano- Weierstrass  theorem 
which  asserts  that  every  bounded  sequence  has  a  convergent  sub¬ 
sequence.  First  we  prove  a  theorem  about  monotonic  subsequences. 


11.4  Theorem. 

Every  sequence  ( sn )  has  a  monotonic  subsequence. 

Proof 

Let’s  say  that  the  n-th  term  is  dominant  if  it  is  greater  than  every 
term  which  follows  it: 

sm  <  sn  for  all  m  >  n.  (1) 

Case  1.  Suppose  there  are  infinitely  many  dominant  terms,  and 
let  (snk)  be  any  subsequence  consisting  solely  of  dominant  terms. 
Then  snk+1  <  snk  for  all  k  by  (1),  so  (s„J  is  a  decreasing  sequence. 

Case  2.  Suppose  there  are  only  finitely  many  dominant  terms.  Se¬ 
lect  n\  so  that  sni  is  beyond  all  the  dominant  terms  of  the  sequence. 
Then 


given  IV  >  ni  there  exists  m  >  N  such  that  sm  >  sn-  (2) 

Applying  (2)  with  N  =  n\  we  select  ri2  >  n\  such  that  sn2  >  sni. 
Suppose  ?ri,  r?2, . . . ,  n^i  have  been  selected  so  that 


ni  <  77,2  <  •  •  •  <  Wfc-l 


(3) 
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and 

•Sni  5;  Sn2  ^  ^  Snk—i'  (4) 

Applying  (2)  with  IV  =  nfc_i  we  select  >  n^_i  such  that  snfc  > 
snk_ i-  Then  (3)  and  (4)  hold  with  k  in  place  of  k  —  1,  the  procedure 
continues  by  induction,  and  we  obtain  an  increasing  subsequence 

(snk)-  ® 


The  elegant  proof  of  Theorem  11.4  was  brought  to  our  attention 
by  David  M.  Bloom  and  is  based  on  a  solution  in  D.  J.  Newman’s 
beautiful  book  [48]. 

11.5  Bolzano- Weierstrass  Theorem. 

Every  bounded  sequence  has  a  convergent  subsequence. 

Proof 

If  (sn)  is  a  bounded  sequence,  it  has  a  nronotonic  subsequence  by 
Theorem  11.4,  which  converges  by  Theorem  10.2.  ■ 

The  Bolzano- Weierstrass  theorem  is  very  important  and  will  be 
used  at  critical  points  in  Chap.  3.  Our  proof,  based  on  Theorem  11.4, 
is  somewhat  nonstandard  for  reasons  we  now  discuss.  Many  of  the 
notions  introduced  in  this  chapter  make  equally  good  sense  in  more 
general  settings.  For  example,  the  ideas  of  convergent  sequence, 
Cauchy  sequence  and  bounded  sequence  all  make  sense  for  a  se¬ 
quence  (sn)  where  each  sn  belongs  to  the  plane.  But  the  idea  of 
a  monotonic  sequence  does  not  carry  over.  It  turns  out  that  the 
Bolzano- Weierstrass  theorem  also  holds  in  the  plane  and  in  many 
other  settings  [see  Theorem  13.5],  but  clearly  it  would  no  longer  be 
possible  to  prove  it  directly  from  an  analogue  of  Theorem  11.4.  Since 
the  Bolzano- Weierstrass  Theorem  11.5  generalizes  to  settings  where 
Theorem  11.4  makes  little  sense,  in  applications  we  will  emphasize 
the  Bolzano- Weierstrass  Theorem  11.5  rather  than  Theorem  11.4. 

We  need  one  more  notion,  and  then  we  will  be  able  to  tie  our 
various  concepts  together  in  Theorem  11.8. 

11.6  Definition. 

Let  (sn)  be  a  sequence  in  R.  A  subsequential  limit  is  any  real  number 
or  symbol  +oo  or  — oo  that  is  the  limit  of  some  subsequence  of  (sn). 
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When  a  sequence  has  a  limit  s,  then  all  subsequences  have  limit 
s,  so  {s}  is  the  set  of  subsequential  limits.  The  interesting  case  is 
when  the  original  sequence  does  not  have  a  limit.  We  return  to  some 
of  the  examples  discussed  after  Definition  11.1. 

Example  5 

Consider  (sn)  where  sn  =  n2(— l)n.  The  subsequence  of  even  terms 
diverges  to  +oo,  and  the  subsequence  of  odd  terms  diverges  to  — oo. 
All  subsequences  that  have  a  limit  diverge  to  +oo  or  —  oo,  so  that 
{— oo,+oo}  is  exactly  the  set  of  subsequential  limits  of  (sn).  □ 

Example  6 

Consider  the  sequence  an  =  sin(r|I)  in  Example  2.  This  sequence 
takes  each  of  the  values  ^  n/3,  0  and  —  ^\/3  an  infinite  number  of 
times.  The  only  convergent  subsequences  are  constant  from  some 
term  on,  and  {  —  j\/3,  0,  j\/3}  is  the  set  of  subsequential  limits  of 
(i an ).  If  rik  =  3k,  then  ank  =  0  for  all  k  £  N  and  obviously 
lim/^oo  ank  =  0.  If  nk  =  6k  +  1,  then  ank  =  i\/3  for  all  k  and 
Urn*..*, 0ank  =  ^y/3.  And  if  nk  =  6k  +  4,  then  lim*..^  ank  = 

□ 

Example  7 

Let  ( rn )  be  a  list  of  all  rational  numbers.  It  was  shown  in  Example  3 
that  every  real  number  is  a  subsequential  limit  of  (rn).  Also,  +oo 
and  — oo  are  subsequential  limits;  see  Exercise  11.7.  Consequently, 
M  U  {— oo,  +oo}  is  the  set  of  subsequential  limits  of  (rn).  □ 

Example  8 

Let  bn  =  n[l  +  (—l)"-]  for  n  G  N.  Then  bn  =  2 n  for  even  n  and  bn  =  0 
for  odd  n.  Thus  the  2-elenrent  set  {0,  +oo}  is  the  set  of  subsequential 
limits  of  ( bn ).  □ 

We  now  turn  to  the  connection  between  subsequential  limits  and 
lim  sup’s  and  lim  inf’s. 

11.7  Theorem. 

Let  (sn)  be  any  sequence.  There  exists  a  monotonic  subsequence 
whose  limit  is  limsupsn,  and  there  exists  a  monotonic  subsequence 
whose  limit  is  lim  inf  sn . 
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Proof 

If  (sn)  is  not  bounded  above,  then  by  Theorem  11.2(H),  a  monotonic 
subsequence  of  (sn)  has  limit  +oo  =  limsup  sn.  Similarly,  if  (sn) 
is  not  bounded  below,  a  monotonic  subsequence  has  limit  — oo  = 
lirninf  sn. 

The  remaining  cases  are  that  (sn)  is  bounded  above  or  is  bounded 
below.  These  cases  are  similar,  so  we  only  consider  the  case  that  (sn) 
is  bounded  above,  so  that  liiri  sup  sn  is  finite.  Let  t  =  lirri  sup  sn,  and 
consider  e  >  0.  There  exists  Nq  so  that 

sup{sn  :  n  >  N}  <  t  +  e  for  N  >  Nq. 

In  particular,  sn  <  t  +  e  for  all  n  >  No.  We  now  claim 

{n  €  N  :  t  —  e  <  sn  <  t  +  e}  is  infinite.  (1) 

Otherwise,  there  exists  N\  >  Nq  so  that  sn  <  t  —  e  for  n  >  N\.  Then 
sup{sn  :  n  >  N}  <  t  —  e  for  N  >  Ni,  so  that  limsups^  <  t,  a  contra¬ 
diction.  Since  (1)  holds  for  each  e  >  0,  Theorem  11.2(i)  shows  that 
a  monotonic  subsequence  of  (sn)  converges  to  t  =  lim  sup  sn.  ■ 

11.8  Theorem. 

Let  (sn)  be  any  sequence  in  M,  and  let  S  denote  the  set  of 
subsequential  limits  of  (sn). 

(i)  S  is  nonempty. 

(ii)  sup^  =  lim  sup  sn  and  inf  S  =  lirninf  sn. 

(iii)  lim  sn  exists  if  and  only  if  S  has  exactly  one  element,  namely 
lim  sn . 

Proof 

(i)  is  an  immediate  consequence  of  Theorem  11.7. 

To  prove  (ii),  consider  any  limit  t  of  a  subsequence  (snk )  of  ( sn ). 
By  Theorem  10.7  we  have  t  =  lim  inf  &  snk  =  limsupfcsnj..  Since 
nk  >  k  for  all  k,  we  have  {snk  :  k  >  N}  C  :  n  >  N}  for  each  N 
in  N.  Therefore 

lirninf  sn  <  lirninf  snk  =  t  =  lim  sup  snk  <  limsup  sn. 
n  k  k  n 

This  inequality  holds  for  all  t  in  S;  therefore 

lim  inf  sn  <  inf  S  <  sup  S  <  lim  sup  sn. 
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Theorem  11.7  shows  that  liminf  sn  and  lirri  sup  sn  both  belong  to  S. 
Therefore  (ii)  holds. 

Assertion  (iii)  is  simply  a  reformulation  of  Theorem  10.7.  ■ 

Theorems  11.7  and  11.8  show  that  lim  sup  sn  is  exactly  the  largest 
subsequential  limit  of  (sn),  and  liminf  sn  is  exactly  the  smallest  sub- 
sequential  limit  of  (sn).  This  makes  it  easy  to  calculate  limsup’s  and 
lim  inf’s. 

We  return  to  the  examples  given  before  Theorem  11.7. 

Example  9 

If  sn  =  n2(— l)n,  then  S  =  {— oo,+oo}  as  noted  in  Example  5. 
Therefore  lim  sup  sn  =  sup  S  =  +oo  and  lim  inf  sn  =  inf  S  = 
— oo.  □ 

Example  10 

If  an  =  sin(^).  then  S  =  {— ^\/3, 0,  ^\/3}  as  observed  in  Exam¬ 
ple  6.  Hence  lim  sup  an  =  sup  S  =  ^\/3  and  lim  inf  an  =  inf  S  = 
-^V3.  □ 

Example  11 

If  ( rn )  denotes  a  list  of  all  rational  numbers,  then  the  set  M  U 
{— oo,+oo}  is  the  set  of  subsequential  limits  of  ( rn ).  Consequently 
we  have  lim  sup  rn  =  +oo  and  liminf  rn  =  — oo.  □ 

Example  12 

If  bn  =  n[  1  +  (— l)n],  then  limsup6n  =  +oo  and  liminf  bn  =  0;  see 
Example  8.  □ 

The  next  result  shows  that  the  set  S  of  subsequential  lim¬ 
its  always  contains  all  limits  of  sequences  from  S.  Such  sets  are 
called  closed  sets.  Sets  of  this  sort  will  be  discussed  further  in  the 
enrichment  §13. 

11.9  Theorem. 

Let  S  denote  the  set  of  subsequential  limits  of  a  sequence  (sn).  Sup¬ 
pose  (tn)  is  a  sequence  in  S  HR  and  that  t  =  lim  tn .  Then  t  belongs 
to  S. 
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Proof 


Suppose  t  is  finite.  Consider  the  interval  (t  —  e,t  T  e).  Then  some  tn 
is  in  this  interval.  Let  5  =  min{i  +  e  —  tn,  tn  —  t  +  e},  so  that 


{tn  -6,tn  +  5)  C(t-e,t  +  e). 


Since  tn  is  a  subsequential  limit,  the  set  {n  E  N  :  sn  €  ( tn  —  8 ,  tn  +  <5)} 
is  infinite,  so  the  set  {n  6  N  :  sn  £  (t  —  e,  fTe)}  is  also  infinite.  Thus, 
by  Theorem  11.2(i),  t  itself  is  a  subsequential  limit  of  (sn). 

If  t  =  Too,  then  clearly  the  sequence  (sn)  is  unbounded  above, 
so  a  subsequence  of  (sn)  has  limit  +oo  by  Theorem  11.2(h).  Thus 
Too  is  also  in  S.  A  similar  argument  applies  if  t  =  — oo.  ■ 

Exercises 

11.1  Let  a„  =  3  +  2(— 1)"  for  n  £  N. 

(a)  List  the  first  eight  terms  of  the  sequence  (an). 

(b)  Give  a  subsequence  that  is  constant  [takes  a  single  value]. 


Specify  the  selection  function  a. 
11.2  Consider  the  sequences  defined  as  follows: 

an  =  (-1)”,  bn  = 


fin  4-  4 


n 


(a)  For  each  sequence,  give  an  example  of  a  monotone  subse¬ 
quence. 

(b)  For  each  sequence,  give  its  set  of  subsequential  limits. 

(c)  For  each  sequence,  give  its  limsup  and  lirninf. 

(d)  Which  of  the  sequences  converges?  diverges  to  Too?  diverges 
to  — oo? 

(e)  Which  of  the  sequences  is  bounded? 

11.3  Repeat  Exercise  11.2  for  the  sequences: 


11.4  Repeat  Exercise  11.2  for  the  sequences: 
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11.5  Let  ( qn )  be  an  enumeration  of  all  the  rationals  in  the  interval  (0, 1]. 

(a)  Give  the  set  of  subsequential  limits  for  ( qn ). 

(b)  Give  the  values  of  lim  sup  qn  and  lim  inf  qn . 

11.6  Show  every  subsequence  of  a  subsequence  of  a  given  sequence  is  itself 
a  subsequence  of  the  given  sequence.  Hint:  Define  subsequences  as 
in  (3)  of  Definition  11.1. 

11.7  Let  ( rn )  be  an  enumeration  of  the  set  Q  of  all  rational  numbers.  Show 
there  exists  a  subsequence  ( rnk )  such  that  lim/^oo  rnk  =  +oo. 

11.8  ★8  Use  Definition  10.6  and  Exercise  5.4  to  prove  lim  inf  sn  = 
—  limsup(— sn)  for  every  sequence  (s„). 

11.9  (a)  Show  the  closed  interval  [a,  &]  is  a  closed  set. 

(b)  Is  there  a  sequence  (sn)  such  that  (0, 1)  is  its  set  of  subsequential 
limits? 

11.10  Let  (sn)  be  the  sequence  of  numbers  in  Fig.  11.2  listed  in  the  indicated 
order. 

(a)  Find  the  set  S  of  subsequential  limits  of  (s„). 

(b)  Determine  lim  sup  sn  and  lim  inf  sn. 


This  exercise  is  referred  to  in  several  places. 
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11.11  Let  S  be  a  bounded  set.  Prove  there  is  an  increasing  sequence  (sn)  of 
points  in  S  such  that  lims^  =  sup  S'.  Compare  Exercise  10.7.  Note: 
If  supS  is  in  S,  it’s  sufficient  to  define  sn  =  supS  for  all  n. 


§12 

lim  sup’s  and  lim  inf’s 

Let  (sn)  be  any  sequence  of  real  numbers,  and  let  S  be  the  set  of 
subsequential  limits  of  (sn).  Recall 

lim  sup  sn  =  lim  sup{sn  :  n  >  N}  =  sup  S 

N — ^OO 

(*) 

and 

lim  inf  sn  =  lim  inf  {sn  :  n  >  N}  =  inf  S. 

N — yoo 

The  first  equalities  in  (*)  and  (**)  are  from  Definition  10.6,  and 
the  second  equalities  are  proved  in  Theorem  11.8.  This  section  is  de¬ 
signed  to  increase  the  students’  familiarity  with  these  concepts.  Most 
of  the  material  is  given  in  the  exercises.  We  illustrate  the  techniques 
by  proving  some  results  that  will  be  needed  later  in  the  text. 

12.1  Theorem. 

If  (sr i)  converges  to  a  positive  real  number  s  and  (tn)  is  any  sequence, 
then 

lim  sup  sntn  =  s  ■  lirri  sup  tn. 

Here  we  allow  the  conventions  s  ■  (+oo)  =  +oo  and  s  ■  (— oo)  =  — oo 
for  s  >  0. 

Proof 

We  first  show 

lim  sup  sntn  >  s  ■  lim  sup  tn.  (1) 

We  have  three  cases.  Let  /3  =  lim  sup  tn . 

Case  1.  Suppose  /3  is  finite. 

By  Theorem  11.7,  there  exists  a  subsequence  (tnk)  of  ( tn )  such 
that  linifc^oo  tnk  =  f3.  We  also  have  lim^oo  snk  =  s  [by  Theo¬ 
rem  11.3],  so  liirifc^oo  sn.ktnk  =  s/3.  Thus  ( snktnk )  is  a  subsequence  of 
( sntn )  converging  to  s/3,  and  therefore  s/3  <  lim  sup  sntn.  [Recall  that 
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limsupsnfn  is  the  largest  possible  limit  of  a  subsequence  of  (sntn).] 
Thus  (1)  holds. 

Case  2.  Suppose  f3  =  +oo. 

There  exists  a  subsequence  ( [tnk )  of  ( tn )  such  that  lim^oo  tnk  = 
Too.  Since  lirn^oo  snk  =  s  >  0,  Theorem  9.9  shows  lim^oo  snktnk  = 
Too.  Hence  limsupsnfn  =  Too,  so  (1)  clearly  holds. 

Case  3.  Suppose  /3  =  — oo. 

Since  s  >  0,  the  right-hand  side  of  (1)  is  equal  to  s  ■  (— oo)  =  — oo. 
Hence  (1)  is  obvious  in  this  case. 

We  have  now  established  (1)  in  all  cases.  For  the  reversed  in¬ 
equality,  we  resort  to  a  little  trick.  First  note  that  we  may  ignore 
the  first  few  terms  of  ( sn )  and  assume  all  sn  0.  Then  we  can  write 
lim  =  -  by  Lemma  9.5.  Now  we  apply  (1)  with  sn  replaced  by 
and  tn  replaced  by  sntn: 

lim  sup  tn  =  lim  sup  ( —  ]  ( sntn )  >  f  -  J  lim  sup  sntn, 

\Sn  \s 


i.e., 


limsups^fn  <  s  ■  lim  sup  tn. 

This  inequality  and  (1)  prove  the  theorem.  ■ 

Example  1 

The  hypothesis  s  be  positive  in  Theorem  12.1  cannot  be  relaxed  to 
allow  s  =  0.  To  see  this,  consider  ( sn )  and  ( tn ),  where  sn  =  — ^  and 
tn  =  —n2  for  all  n.  In  this  setting,  we  don’t  define  0-  (— oo),  but  even 
if  we  did,  we  wouldn’t  define  this  product  to  be  Too.  □ 


The  next  theorem  will  be  useful  in  dealing  with  infinite  series; 
see  the  proof  of  the  Ratio  Test  14.8. 

12.2  Theorem. 

Let  (sn)  be  any  sequence  of  nonzero  real  numbers.  Then  we  have 


lim  inf 


^71+1 


<  lim  inf  |sn|1//n  <  lim  sup  \sn\l^n  <  lim  sup 


•Sn+l 
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Proof 

The  middle  inequality  is  obvious.  The  first  and  third  inequalities 
have  similar  proofs.  We  will  prove  the  third  inequality  and  leave  the 
first  inequality  to  Exercise  12.11. 

Let  a  =  lim  sup  I  sn  1 1'n  and  L  =  lim  sup  I  I .  We  need  to  prove 
a  <  L.  This  is  obvious  if  L  =  +oo,  so  we  assume  L  <  +oo.  To  prove 
a  <  L  it  suffices  to  show 


a  <  L\  for  any  L\  >  L. 


(1) 


Since 


L  =  lim  sup 


^n+1 


=  lim  sup 

TV— >-oo 


^n+1 


n  >  N  >  <  L 


there  exists  a  positive  integer  N  such  that 


sup 


Thus 


•Sn+l 


:  n>  N  >  <L\. 


<  L\  for  n>  N. 


(2) 


Now  for  n  >  IV  we  can  write 


Sn.  — 


Sn 

Sn—  1 

•S7V+1 

Sn—l 

Sn- 2 

SN 

\sn\- 


There  are  n  —  (N  +  1)  +  1  =  n  —  N  fractions  here,  so  applying  (2) 
we  see  that 

|sn|  <  L™~n\sn\  for  n>  N. 

Since  L\  and  N  are  fixed  in  this  argument,  a  =  L^lsjvl  is  a  positive 
constant  and  we  may  write 


|sn|  <  L^a  for  n  >  N. 


Therefore  we  have 


|sn|1/n  <  Lxaxln  for  n  >  N. 

Since  lim^^oo  al^n  =  1  by  Theorem  9.7(d)  on  page  48,  we  conclude 
a  =  lirnsup  |sn|1,/n  <  Li!  see  Exercise  12.1.  Consequently  (1)  holds 
as  desired.  ■ 
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12.3  Corollary. 

If  lim|^±i|  exists  [and  equals  L],  then  lim  exists  [and 

equals  L] . 

Proof 

If  lim  I  %±I|  =  L,  then  all  four  values  in  Theorem  12.2  are  equal  to  L. 
Hence  lim  |sn|ly/n  =  L;  see  Theorem  10.7.  ■ 

Example  2 

(a)  If  L  =  lim  sup  sn  ^  oo,  then  for  every  a  >  L,  the  set  {n  : 
sn  >  a}  is  finite.  If  I  ^  — oo,  then  for  every  /3  <  L,  the  set 
{n  :  sn  >  /?}  is  infinite. 

If  L  ^  oo  and  a  >  L,  the  set  {n  :  sn  >  a}  is  finite;  otherwise 
sup{sn  :  n  >  N}  >  a  for  all  N  and  hence  L  =  lim  sup  sn  > 
a  >  L,  a  contradiction;  see  Definition  10.6.  If  L  ^  — oo  and 
/3  <  L,  the  set  {n  :  sn  >  /5 }  is  infinite;  otherwise  there  exists  a 
positive  integer  Nq  so  that  sn  <  f3  for  all  n  >  Nq,  and  therefore 
sup{sn  :  n  >  N }  <  /3  for  all  N  >  Nq.  Then  lim  sup  sn  <  (3  <  L, 
a  contradiction. 

(b)  The  set  {n  :  sn  >  lim  sup  can  be  infinite.  For  example, 
consider  ( sn )  where  sn  =  K  The  set  {n  :  sn  <  lim  inf  sn}  can 
also  be  infinite;  use  sn  =  —K 

(c)  If  Lo  =  lim  inf  tn  ^  — oo,  then  the  set  {n  :  tn  <  /3o}  is  finite  for 
A)  <  Lq.  If  L0  ±  oo,  then  the  set  {n  :  tn  <  ao}  is  infinite  for 
ot 0  >  Lq. 

This  follows  from  part  (a)  and  Exercise  11.8: 

Lo  =  lim  inf  tn  =  —  limsup(— tn)  =  —  L  =  —  lim  sup  sn, 

where  sn  =  —tn  and  L  is  as  defined  in  part  (a).  Now  A)  <  Lo 
implies  —  A  >  —Lo  =  L,  so  by  part  (a), 

{n  :  tn  <  /30}  =  {n  :  -tn  >  -A}  =  {n  :  sn  >  — /30}  is  finite. 

Similarly,  ao  >  Lo  implies  — ao  <  L,  so 

{n  :  tn  <  ao}  =  { n  :  —tn  >  — ao}  =  {n  :  sn  >  — ao}  is  infinite. 

(d)  If  lim  inf  Inn  sup  sn,  the  set 

{n  :  lim  inf  sn  <  sn  <  lim  sup  sn} 
can  be  empty.  Use,  for  example,  sn  =  (— l)n(l  +  -).  □ 
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Exercises 

12.1  Let  (s„)  and  (tn)  be  sequences  and  suppose  there  exists  No  such  that 

sn  <  tn  for  all  n  >  No.  Show  lim  inf  <  lim  inf  and  limsupSn  < 
lim  sup  Hint :  Use  Definition  10.6  and  Exercise  9.9(c). 

12.2  Prove  lim  sup  |s„|  =  0  if  and  only  if  lim  sn  =  0. 

12.3  Let  (sn)  and  (tn)  be  the  following  sequences  that  repeat  in  cycles  of 
four: 

(«»)  =  (0,1, 2, 1,0, 1,2, 1,0, 1,2, 1,0, 1,2, 1,0,...) 

(t„)  =  (2, 1,1, 0,2, 1,1, 0,2, 1,1, 0,2, 1,1, 0,2,...) 

Find 

(a)  lim  inf  sn  T  lim  inf  tn,  (b)  lim  inf  (sn  T  tn), 

(c)  lim  inf  sn  T  lim  sup  tn,  (d)  limsup(s„  +  tn), 

(e)  limsup sn  +  limsuptn,  (f)  liminf(sntn), 

(g)  limsup(snt„) 

12.4  Show  limsup(srl  +  trj)  <  limsup  sn+  lim  sup  tn  for  bounded  sequences 
(sn)  and  (tn).  Hint :  First  show 

sup{s„  +  tn  :  n  >  N}  <  sup{s„  :  n  >  N}  +  sup{tn  :  n  >  N}. 

Then  apply  Exercise  9.9(c). 

12.5  Use  Exercises  11.8  and  12.4  to  prove 

lim  inf  (sn  +  tn)  >  lim  inf  sn  +  lim  inf  tn 
for  bounded  sequences  (sn)  and  (tn). 

12.6  Let  (sn)  be  a  bounded  sequence,  and  let  k  be  a  nonnegative  real 
number. 

(a)  Prove  limsup(fcsrl)  =  k  ■  lim  sup  sn. 

(b)  Do  the  same  for  lim  inf.  Hint:  Use  Exercise  11.8. 

(c)  What  happens  in  (a)  and  (b)  if  k  <  0? 

12.7  Prove  if  lim  sup  .sn  =  +oo  and  k  >  0,  then  limsup(fcsn)  =  +oo. 

12.8  Let  (sn)  and  (tn)  be  bounded  sequences  of  nonnegative  numbers. 
Prove  limsupsnf„  <  (limsupsn)(limsuptra). 

12.9  (a)  Prove  that  if  limsn  =  +oo  and  lim  inf  tn  >  0,  then  lims^t^  = 

Too. 

(b)  Prove  that  if  lim  sup  sn  =  Too  and  lim  inf  tn  >  0,  then 
limsupsnt„  =  Too. 
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(c)  Observe  that  Exercise  12.7  is  the  special  case  of  (b)  where  tn  =  k 
for  all  n  £  N. 

12.10  Prove  (s„)  is  bounded  if  and  only  if  limsup  |sn|  <  +oo. 

12.11  Prove  the  first  inequality  in  Theorem  12.2. 

12.12  Let  (sra)  be  a  sequence  of  nonnegative  numbers,  and  for  each  n  define 

O'n  =  “(Si  +  s2  +  ’  '  '  +  Sn). 

(a)  Show 

liminfsn  <  liminfovj  <  lim sup an  <  limsup  sn. 

Hint :  For  the  last  inequality,  show  first  that  M  >  N  implies 

sup{<7„  :  n  >  M}  <  -(si  +  s2H - |-SAr)  +  sup{s„  :  n  >  IV}. 

(b)  Show  that  if  limsra  exists,  then  lim<T„  exists  and  limcrn  = 
lim  sn. 

(c)  Give  an  example  where  lim  crn  exists,  but  lim  sn  does  not  exist. 

12.13  Let  ( sn )  be  a  bounded  sequence  in  R.  Let  A  be  the  set  ofa€l  such 
that  (n  £  N  :  sn  <  a}  is  finite,  i.e. ,  all  but  finitely  many  sn  are  >  a. 
Let  B  be  the  set  of  b  e  R  such  that  {n  £  N  :  sn  >  b}  is  finite.  Prove 
sup  A  =  lim  inf  sn  and  inf  B  =  lim  sup  sn. 

12.14  Calculate  (a)  lim(n!)1/n,  (b)  lim  ^(n!)1/". 

§13  *  Some  Topological  Concepts  in  Metric 

Spaces 

In  this  book  we  are  restricting  our  attention  to  analysis  on  M.  Ac¬ 
cordingly,  we  have  taken  full  advantage  of  the  order  properties  of  M 
and  studied  such  important  notions  as  lim  sup’s  and  lim  inf’s.  In  §3 
we  briefly  introduced  a  distance  function  on  M.  Most  of  our  analy¬ 
sis  could  have  been  based  on  the  notion  of  distance,  in  which  case 
it  becomes  easy  and  natural  to  work  in  a  more  general  setting.  For 
example,  analysis  on  the  ^-dimensional  Euclidean  spaces  is  im¬ 
portant,  but  these  spaces  do  not  have  the  useful  natural  ordering 
that  K  has,  unless  of  course  k  =  1. 
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13.1  Definition. 

Let  S  be  a  set,  and  suppose  d  is  a  function  defined  for  all  pairs  (x,  y ) 
of  elements  from  S  satisfying 

Dl.  d(x,x)  =  0  for  all  x  E  S  and  d(x,y)  >  0  for  distinct  x,y  in  S. 
D2.  d(x,y)  =  d(y,x)  for  all  x,y  E  S. 

D3.  d(x,  z)  <  d(x,  y )  +  d(y,  z)  for  all  x,y,  z  E  S. 

Such  a  function  d  is  called  a  distance  function  or  a  metric  on  S. 
A  metric  space  S'  is  a  set  S  together  with  a  metric  on  it.  Properly 
speaking,  the  metric  space  is  the  pair  (S,  d)  since  a  set  S  may  well 
have  more  than  one  metric  on  it;  see  Exercise  13.1. 


Example  1 

As  in  Definition  3.4,  let  dist(a,  b)  =  |a  —  b\  for  a,  b  £  R.  Then  dist  is 
a  metric  on  M.  Note  Corollary  3.6  gives  D3  in  this  case.  As  remarked 
there,  the  inequality 

dist(a,  c)  <  dist  (a,  b)  +  dist  (6,  c) 

is  called  the  triangle  inequality.  In  fact,  for  any  metric  d,  property 
D3  is  called  the  triangle  inequality.  □ 


Example  2 

The  space  of  all  fe-tuples 


x  =  (aq, X2,  ■  ■  ■ , Xk)  where  xj  €  K  for  j  =  1.2, . . .  ,k, 

is  called  k-  dimensional  Euclidean  space  and  written  Rfc.  As  noted  in 
Exercise  13.1,  has  several  metrics  on  it.  The  most  familiar  metric 
is  the  one  that  gives  the  ordinary  distance  in  the  plane  R2  or  in 
3-space  R3: 


d(x,y) 


1/2 


3= 1 


for  x,  y  6  Rfc. 


[The  summation  notation  ^  is  explained  in  14.1.]  Obviously  this 
function  d  satisfies  properties  Dl  and  D2.  The  triangle  inequality 
D3  is  not  so  obvious.  For  a  proof,  see  for  example  [53,  §6.1]  or 
[62,  1.37].  □ 
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13.2  Definition. 

A  sequence  (sn)  in  a  metric  space  (S,d)  converges  to  s  in  S  if 
limn_>00  d(sn,  s)  =  0.  A  sequence  (sn)  in  S  is  a  Cauchy  sequence 
if  for  each  e  >  0  there  exists  an  N  such  that 

m,n>N  implies  d(sm,sn)<e. 

The  metric  space  (S,  d)  is  said  to  be  complete  if  every  Cauchy 
sequence  in  S  converges  to  some  element  in  S. 


Since  the  Completeness  Axiom  4.4  deals  with  least  upper  bounds, 
the  word  “complete”  now  appears  to  have  two  meanings.  However, 
these  two  uses  of  the  term  are  very  closely  related  and  both  reflect  the 
property  that  the  space  is  complete,  i.e.,  has  no  gaps.  Theorem  10.11 
asserts  that  the  metric  space  (M,  dist)  is  a  complete  metric  space,  and 
the  proof  uses  the  Completeness  Axiom  4.4.  We  could  just  as  well 
have  taken  as  an  axiom  the  completeness  of  (M,  dist)  as  a  metric  space 
and  proved  the  least  upper  bound  property  in  4.4  as  a  theorem.  We 
did  not  do  so  because  the  concept  of  least  upper  bound  in  M  seems 
to  us  more  fundamental  than  the  concept  of  Cauchy  sequence. 

We  will  prove  is  complete.  But  we  have  a  notational  problem, 
since  we  like  subscripts  for  sequences  and  for  coordinates  of  points 
in  Rfc.  When  there  is  a  conflict,  we  will  write  (auni)  for  a  sequence 
instead  of  (xn).  In  this  case, 


An)  _  (An)  (n) 

iT  -  ^  it/  2  j  i  %Jb 


(n)'i 

k  ) 


Unless  otherwise  specified,  the  metric  in  is  always  as  given  in 
Example  2. 


13.3  Lemma. 

A  sequence  (aunl)  in  Rfc  converges  if  and  only  if  for  each  j  = 
1,2 the  sequence  ( x converges  in  M.  A  sequence  (x^) 

in  Mfc  is  a  Cauchy  sequence  if  and  only  if  each  sequence  (x^)  is  a 
Cauchy  sequence  in  M. 

Proof 

The  proof  of  the  first  assertion  is  left  to  Exercise  13.2(b).  For  the 
second  assertion,  we  first  observe  for  x,  y  in  and  j  =  1,2,...,  fe, 

\xj  -yj  |  <  d(x,y)  <  Vkmax{\xj  -  yj\  :  j  =  1,2  ,...,&}.  (1) 
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Suppose  ( x (n))  is  a  Cauchy  sequence  in  Rfc,  and  consider  fixed  j. 
If  e  >  0,  there  exists  TV  such  that 

m,n>  N  implies  d{x^m\x^)  <  e. 

From  the  first  inequality  in  (1)  we  see  that 

m,n  >  TV  implies  \x^  ~  <  e> 

so  )  is  a  Cauchy  sequence  in  R. 

Now  suppose  each  sequence  (x^ )  is  a  Cauchy  sequence  in  R.  Let 
e  >  0.  For  j  =  1, 2, . . . ,  k,  there  exist  Nj  such  that 

m,n  >  Nj  implies  \x ^  —  xf^\  <  —j=. 

J  J  \]k 

If  TV  =  m  ax  {TV] ,  TV2, . . . ,  TVfc},  then  by  the  second  inequality  in  (1), 
m,n>  N  implies  d{x^m\x^)  <  e, 
i.e.,  ( x is  a  Cauchy  sequence  in  Rfc.  ■ 

13.4  Theorem. 

Euclidean  k -space  Rfc  is  complete. 

Proof 

Consider  a  Cauchy  sequence  (x^)  in  Rfc.  By  Lemma  13.3,  (x^n> ) 
is  a  Cauchy  sequence  in  R  for  each  j.  Hence  by  Theorem  10.11, 
(x^)  converges  to  some  real  number  Xj.  By  Lemma  13.3  again,  the 
sequence  (x^)  converges,  in  fact  to  x  =  (xi,  X2,  ■  ■  ■ ,  x &).  ■ 

We  now  prove  the  Bolzano- Weierstrass  theorem  for  Rfc;  compare 
Theorem  11.5.  A  set  S  in  Rfc  is  bounded  if  there  exists  M  >  0  such 
that 

max{|xj|  :  j  =  1, 2, . . . ,  k}  <  M  for  all  x  =  (xi,  X2,  ■  ■  ■ ,  X&)  €  S. 

13.5  Bolzano- Weierstrass  Theorem. 

Every  bounded  sequence  in  Rfc  has  a  convergent  subsequence. 

Proof 

Let  (*("))  be  a  bounded  sequence  in  Rfc.  Then  each  sequence  (x^) 
is  bounded  in  R.  By  Theorem  11.5,  we  may  replace  ( x by  a 
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subsequence  such  that  (x^)  converges.  By  the  same  theorem,  we 
may  replace  (x^n'))  by  a  subsequence  of  the  subsequence  such  that 
(x^)  converges.  Of  course,  (x j"'1 )  still  converges  by  Theorem  11.3. 
Repeating  this  argument  k  times,  we  obtain  a  sequence  (x^)  so 
that  each  sequence  (x^)  converges,  j  =  1,2 ,...,k.  This  sequence 
represents  a  subsequence  of  the  original  sequence,  and  it  converges 
in  Mfc  by  Lemma  13.3.  ■ 

13.6  Definition. 

Let  (S,  d )  be  a  metric  space.  Let  E  be  a  subset  of  S.  An  element 
so  £E  E  is  interior  to  E  if  for  some  r  >  0  we  have 

{s  e  S  :  d(s,  so)  <  r}  C  E. 

We  write  E°  for  the  set  of  points  in  E  that  are  interior  to  E.  The 
set  E  is  open  in  S  if  every  point  in  E  is  interior  to  E,  i.e.,  if  if  =  E°. 

13.7  Discussion. 

One  can  show  [Exercise  13.4] 

(i)  S  is  open  in  S  [trivial]. 

(ii)  The  empty  set  0  is  open  in  S  [trivial]. 

(iii)  The  union  of  any  collection  of  open  sets  is  open. 

(iv)  The  intersection  of  finitely  many  open  sets  is  again  an  open 

set.  □ 

Our  study  of  and  the  exercises  suggest  that  metric  spaces  are 
fairly  general  and  useful  objects.  When  one  is  interested  in  conver¬ 
gence  of  certain  objects  [such  as  points  or  functions],  there  is  often 
a  metric  that  assists  in  the  study  of  the  convergence.  But  sometimes 
no  metric  will  work  and  yet  there  is  still  some  sort  of  convergence  no¬ 
tion.  Frequently  the  appropriate  vehicle  is  what  is  called  a  topology. 
This  is  a  set  S  for  which  certain  subsets  are  decreed  to  be  open  sets. 
In  general,  all  that  is  required  is  that  the  family  of  open  sets  satisfies 
(i)-(iv)  above.  In  particular,  the  open  sets  defined  by  a  metric  form  a 
topology.  We  will  not  pursue  this  abstract  theory.  However,  because 
of  this  abstract  theory,  concepts  that  can  be  defined  in  terms  of  open 
sets  [see  Definitions  13.8,  13.11,  and  22.1]  are  called  topological,  hence 
the  title  of  this  section. 
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13.8  Definition. 

Let  (S,  d )  be  a  metric  space.  A  subset  E  of  S  is  closed  if  its  comple¬ 
ment  S  \  E  is  an  open  set.  In  other  words,  E  is  closed  if  E  =  S\U 
where  U  is  an  open  set. 

Because  of  (iii)  in  Discussion  13.7,  the  intersection  of  any  collec¬ 
tion  of  closed  sets  in  closed  [Exercise  13.5].  The  closure  E~  of  a  set 
E  is  the  intersection  of  all  closed  sets  containing  E.  The  boundary 
of  E  is  the  set  E~  \  E°\  points  in  this  set  are  called  boundary  points 
of  E. 

To  get  a  feel  for  these  notions,  we  state  some  easy  facts  and  leave 
the  proofs  as  exercises. 

13.9  Proposition. 

Let  E  be  a  subset  of  a  metric  space  ( S,d ). 

(a)  The  set  E  is  closed  if  and  only  if  E  =  E~ . 

(b)  The  set  E  is  closed  if  and  only  if  it  contains  the  limit  of  every 
convergent  sequence  of  points  in  E. 

(c)  An  element  is  in  E~  if  and  only  if  it  is  the  limit  of  some 
sequence  of  points  in  E. 

(d)  A  point  is  in  the  boundary  of  E  if  and  only  if  it  belongs  to  the 
closure  of  both  E  and  its  complement. 

Example  3 

In  M,  open  intervals  (a,  b )  are  open  sets.  Closed  intervals  [a,  b]  are 
closed  sets.  The  interior  of  [a,  b]  is  (a,  b).  The  boundary  of  both  (a,  b) 
and  [a,  6]  is  the  two-element  set  {a,  6}. 

Every  open  set  in  K  is  the  union  of  a  disjoint  sequence  of  open 
intervals  [Exercise  13.7].  A  closed  set  in  M  need  not  be  the  union  of 
a  disjoint  sequence  of  closed  intervals  and  points;  such  a  set  appears 
in  Example  5. 

No  open  interval  (a,  b)  or  closed  interval  [a,  b],  with  a  <  b,  can 
be  written  as  the  disjoint  union  of  two  or  more  closed  intervals,  each 
having  more  than  one  point.  This  is  proved  in  Theorem  21.11.  □ 

Example  4 

In  Mfc,  open  balls  {x  :  d(x,x o)  <  r}  are  open  sets,  and  closed  balls 
{x  :  d(x,x o)  <  r}  are  closed  sets.  The  boundary  of  each  of  these 
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sets  is  {x  :  d(x,  xq)  =  r}.  In  the  plane  M2,  the  sets 

{(xi,X2)  :  x\  >  0}  and  {(xi,X2)  ■  x\  >  0  and  X2  >  0} 

are  open.  If  >  is  replaced  by  >,  we  obtain  closed  sets.  Many  sets 
are  neither  open  nor  closed.  For  example,  [0, 1)  is  neither  open  nor 
closed  in  M,  and  {(aq,^)  :  x\  >  0  and  X2  >  0}  is  neither  open  nor 
closed  in  M2.  □ 

13.10  Theorem. 

Let  (Fri)  be  a  decreasing  sequence  [i.e.,  F\  D  F2  A  •  •  •]  of  closed 
bounded  nonempty  sets  in  Mfc.  Then  F  =  n ^=1Fn  is  also  closed, 
bounded  and  nonempty. 

Proof 

Clearly  F  is  closed  and  bounded.  It  is  the  nonemptiness  that 
needs  proving!  For  each  n,  select  an  element  xn  in  Fn.  By  the 
Bolzano- Weierstrass  Theorem  13.5,  a  subsequence  (s„m)“=1  of  (xn) 
converges  to  some  element  xq  in  Rfc.  To  show  xq  E  F,  it  suf¬ 
fices  to  show  xq  E  Fno  with  no  fixed.  If  m  >  no,  then  nm  >  uq, 
so  xUm  E  Fnm  C  Fno.  Hence  the  sequence  (xrim)™=no  consists  of 
points  in  Fno  and  converges  to  xq.  Thus  xq  belongs  to  Fno  by  (b)  of 
Proposition  13.9.  ■ 

Example  5 

Here  is  a  famous  nonempty  closed  set  in  K  called  the  Cantor  set. 
Pictorially,  F  =  C\^=lFn  where  Fn  are  sketched  in  Fig.  13.1.  The 
Cantor  set  has  some  remarkable  properties.  The  sum  of  the  lengths  of 
the  intervals  comprising  Fn  is  and  this  tends  to  0  as  n  — >  00. 

Yet  the  intersection  F  is  so  large  that  it  cannot  be  written  as  a 
sequence;  in  set-theoretic  terms  it  is  “uncountable.”  The  interior 
of  F  is  the  empty  set,  so  F  is  equal  to  its  boundary.  For  more  details, 
see  [62,  2.44],  or  [31,  6.62],  □ 

13.11  Definition. 

Let  (S,  d)  be  a  metric  space.  A  family  U  of  open  sets  is  said  to  be  an 
open  cover  for  a  set  E  if  each  point  of  E  belongs  to  at  least  one  set 
in  U ,  i.e., 


E  C  [J{U  :  U  E  U}. 
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FIGURE  13.1 


A  subcover  of  U  is  any  subfamily  of  U  that  also  covers  E.  A  cover 
or  subcover  is  finite  if  it  contains  only  finitely  many  sets;  the  sets 
themselves  may  be  infinite. 

A  set  E  is  compact  if  every  open  cover  of  E  has  a  finite  subcover 
of  E. 

This  rather  abstract  definition  is  very  important  in  advanced 
analysis;  see,  for  example,  [30].  In  Rfc,  compact  sets  are  nicely 
characterized,  as  follows. 

13.12  Heine-Borel  Theorem. 

A  subset  E  of  Rfc  is  compact  if  and  only  if  it  is  closed  and  bounded. 

Proof 

Suppose  E  is  compact.  For  each  m  £  N,  let  Um  consist  of  all  x  in 
Rfc  such  that 


max{|xj|  :  j  =  1,  2, . . . ,  k}  <  m. 

The  family  U  =  {Um  :  m  £  N}  is  an  open  cover  of  E  [it  covers  Rfc!], 
so  a  finite  subfamily  of  U  covers  E.  If  Umo  is  the  largest  member  of 
the  subfamily,  then  E  C  Umo.  It  follows  that  E  is  bounded.  To  show 
E  is  closed,  consider  any  point  xq  in  Rfc  \  E.  For  m  E  N,  let 


Kn 


€  Rfc  :  d(x,  xq)  > 


m 
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Then  each  Vm  is  open  in  and  V  =  {Vm  :  m  €  N}  covers  E  since 
U™=1Vm  =  \  {xo}.  Since  E  can  be  covered  by  finitely  many  Vm, 

for  some  mo  we  have 

E  C  I  x  £  Mfc  :  d(x,  xq )  >  —  1  . 

I  m0  J 

Thus  {x  6  :  d(x,x o)  <  C  \  E,  so  that  xq  is  interior  to 

~Rk\E.  Since  xq  in  Mfc\£’  was  arbitrary,  M.k\E  is  an  open  set.  Hence 
E  is  a  closed  set. 

Now  suppose  E  is  closed  and  bounded.  Since  E  is  bounded,  E  is 
a  subset  of  some  set  F  having  the  form 

F  =  {x  G  Mfc  :  \xj\  <  m  for  j  =  1,2,...,  k}. 

As  noted  in  Exercise  13.12,  it  suffices  to  prove  F  is  compact.  We  do 
so  in  the  next  proposition  after  some  preparation.  ■ 


The  set  F  in  the  last  proof  is  a  k-cell  because  it  has  the  following 
form.  There  exist  closed  intervals  [oi,  b\\,  [02,  b?\,  . . . ,  [a^,  b^\  so  that 

F  =  {x  €  Rfc  :  Xj  G  [a3 ,  bj]  for  j  =  1,2, ,  k}, 

which  is  sometimes  written  as 


F  =  [ai,  bi]  x  [a2,  b2]  x  •  •  •  x  [afc,  6fc], 


so  it  is  a  /c-dimensional  box  in  Mfc.  Thus  a  2-cell  in  M2  is  a  closed 
rectangle.  A  3-cell  in  M3  is  called  a  “rectangular  parallelepiped.”  The 
diameter  of  F  is 


<5  = 


1  1/2 


at) 


i=l 


that  is,  5  =  sup {d(x,y)  :  x,y  G  F}.  Using  midpoints  Cj  =  3(aj  +bj ) 
of  [aj,  6j],  we  see  that  F  is  a  union  of  2k  fc-cells  each  having  diameter 
-.  If  this  remark  is  not  clear,  consider  first  the  cases  k  =  2  and  k  =  3. 


13.13  Proposition. 

Every  k-cell  F  in  is  compact. 

Proof 

Assume  F  is  not  compact.  Then  there  exists  an  open  cover  U  of  F,  no 
finite  subfamily  of  which  covers  F.  Let  5  denote  the  diameter  of  F. 
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As  noted  above,  F  is  a  union  of  2k  /c-cells  having  diameter  4 .  At  least 
one  of  these  2k  fc-cells,  which  we  denote  by  F\,  cannot  be  covered 
by  finitely  many  sets  from  U.  Likewise,  F\  contains  a  fc-cell  F2  of 
diameter  j  which  cannot  be  covered  by  finitely  many  sets  from  IA. 
Continuing  in  this  fashion,  we  obtain  a  sequence  (Fn)  of  fc-cells  such 
that 

Fx  D  F2  D  F3  D  •  •  • ;  (1) 

Fn  has  diameter  5  ■  2~n ;  (2) 

Fn  cannot  be  covered  by  finitely  many  sets  from  U.  (3) 

By  Theorem  13.10,  the  intersection  n^=1Fn  contains  a  point  xq.  This 
point  belongs  to  some  set  Uq  in  U.  Since  U$  is  open,  there  exists  r  >  0 
so  that 

{x  E  Rfc  :  d(x,  *0)  <  r}  C  Uq. 

It  follows  that  Fn  C  Uq  provided  5  ■  2~n  <  r,  but  this  contradicts  (3) 
in  a  dramatic  way.  ■ 

Since  M  =  M1,  the  preceding  results  apply  to  R. 

Example  6 

Let  E  be  a  nonempty  subset  of  a  metric  space  ( S,d ).  Consider  the 
function  d(E,x )  =  inf {d(y,x)  :  y  €  E}  for  x  £  S.  This  function 
satisfies  \d(E,x  1)  —  d(E,x2)\  <  d(x i,x2)  for  x\,x2  in  S. 

We  show  that  if  E  is  compact  and  if  E  C  U  for  some  open  subset 
U  of  S,  then  for  some  5  >  0  we  have 

{16/S:  d(E,x )  <  5}  C  U.  (1) 

For  each  x  €  E,  we  have 

{j/6S:  d(y,x )  <  rx}  C  U  for  some  rx  >  0.  (2) 

The  open  balls  {y  G  S  :  d(y,  x )  <  rx/ 2}  cover  E,  so  a  finite  subfamily 
also  covers  E.  I.e.,  there  are  x\, . . . ,  xn  in  E  so  that 

n 

E  C  1J  \y  6  S  :  d{y,xk)  <  |  , 

k= 1 

where  we  write  for  rXk.  Now  let  5  =  ^  minjri, . . . , rn}.  To 
prove  (1),  consider  x  E  5  and  suppose  d(E,x )  <  (5.  Then  for  some 
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y  6  E,  we  have  d(y,x)  <  6.  Moreover,  d(y,xk)  <  -y  for  some 
k  £  {1,2,...,  n}.  Therefore,  for  this  k  we  have 

d{x,  xk)  <  d(x,  y )  +  d(y,  Xfc)  <  6  +  y  <  y  +  y  =  Dfc- 

Thus,  by  (2)  applied  to  x  =  xk,  we  see  that  x  belongs  to  U.  Hence  (1) 
holds.  □ 


Exercises 

13.1  For  points  x,  y  in  Mfe,  let 

di{x,y)  =max{|a;J  -%|  :  j  =  1, 2, . . . ,  k} 

and 

k 

d-2(x,y)  =  '52\xj-yj\. 
j= i 

(a)  Show  di  and  d?  are  metrics  for  Kfe. 

(b)  Show  d\  and  d2  are  complete  metrics  on  Rfc. 

13.2  (a)  Prove  (1)  in  Lemma  13.3. 

(b)  Prove  the  first  assertion  in  Lemma  13.3. 

13.3  Let  B  be  the  set  of  all  bounded  sequences  x  =  (xi,X2,  ■  ■  •),  and  define 
d(x,  y)  =  supflajj  -  yj\  :j  =  1,2,.. .}. 

(a)  Show  d  is  a  metric  for  B. 

(b)  Does  d*(x,  y)  =  \xj  ~  Vj\  define  a  metric  for  B7 

13.4  Prove  (iii)  and  (iv)  in  Discussion  13.7. 

13.5  (a)  Verify  one  of  DeMorgan’s  Laws  for  sets: 

nm  U  :  U  €  U}  =  S  \  (J{Z7  :  U  G  U}. 

(b)  Show  that  the  intersection  of  any  collection  of  closed  sets  is  a 
closed  set. 

13.6  Prove  Proposition  13.9. 

13.7  Show  that  every  open  set  in  R  is  the  disjoint  union  of  a  finite  or 
infinite  sequence  of  open  intervals. 
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13.8  (a)  Verify  the  assertions  in  the  first  paragraph  of  Example  3. 

(b)  Verify  the  assertions  in  Example  4. 

13.9  Find  the  closures  of  the  following  sets: 

(a)  {±  :  n  £  N}, 

(b)  Q,  the  set  of  rational  numbers, 

(c)  {r  £  Q  :  r2  <  2}. 

13.10  Show  that  the  interior  of  each  of  the  following  sets  is  the  empty  set. 

(a)  {±  :  n  £  N}, 

(b)  Q,  the  set  of  rational  numbers, 

(c)  The  Cantor  set  in  Example  5. 

13.11  Let  E  be  a  subset  of  Rfc.  Show  that  E  is  compact  if  and  only  if  every 
sequence  in  E  has  a  subsequence  converging  to  a  point  in  E. 

13.12  Let  (5,  d)  be  any  metric  space. 

(a)  Show  that  if  E  is  a  closed  subset  of  a  compact  set  F,  then  E 
is  also  compact. 

(b)  Show  that  the  finite  union  of  compact  sets  in  S  is  compact. 

13.13  Let  E  be  a  compact  nonempty  subset  of  R.  Show  supE  and  inf  E 
belong  to  E. 

13.14  Let  E  be  a  compact  nonempty  subset  of  Rfe,  and  let  5  =  sup{d(;c,  y)  : 
x,y  £  E}.  Show  E  contains  points  xo,  yQ  such  that  d(xo,y0)  =  5. 

13.15  Let  (B,  d )  be  as  in  Exercise  13.3,  and  let  F  consist  of  all  x  £  B  such 
that  sup{|xj|  :  j  =  1, 2, . . .}  <  1. 

(a)  Show  F  is  closed  and  bounded.  [A  set  F  in  a  metric  space 
(S,  d)  is  bounded  if  there  exist  sq  £  S  and  r  >  0  such  that 
F  C  {s  £  S  :  d(s,  s0)  <  r}.] 

(b)  Show  F  is  not  compact.  Hint :  For  each  x  in  F,  let  U{x)  = 
{y  £  B  :  d(y,x)  <  1},  and  consider  the  cover  U  of  F  consist¬ 
ing  of  all  U(x).  For  each  n  £  N,  let  x^  be  defined  so  that 

=  —l  and  x ^  =  1  for  j  n.  Show  that  distinct  x 
cannot  belong  to  the  same  member  of  U. 
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§14  Series 

Our  thorough  treatment  of  sequences  allows  us  to  now  quickly  obtain 
the  basic  properties  of  infinite  series. 

14.1  Summation  Notation. 

The  notation  Ylk=m  ak  is  shorthand  for  the  sum  a?n+am+i  +  -  •  -+an. 
The  symbol  instructs  us  to  sum  and  the  decorations  “k  =  m ” 
and  “n”  tell  us  to  sum  the  summands  obtained  by  successively  sub¬ 
stituting  m,  m  + 1, . . . ,  n  for  k.  For  example,  Ylk= 2  k2+k  shorthand 
for 

1  ,  1  ,  1  ,  1  _  i  1  ,  i  ,  i 

22  +  2  +  32  +  3  +  42  +  4  +  52  +  5  _6  +  12  +  20  +  30 

and  2~k  is  shorthand  for  1  +  ^  +  \  +  ■  ■  ■  +  ^. 

The  symbol  Y^=m  an  is  shorthand  for  am  +  am+ 1  +  am+2  H - , 

although  we  have  not  yet  assigned  meaning  to  such  an  infinite  sum. 
We  now  do  so.  □ 


14.2  Infinite  Series. 

To  assign  meaning  to  ^2^=rnan,  we  consider  the  sequences  (sn)<^=m 
of  partial  sums: 

n 

Sn  =  Am  +  ttm+1  +  ‘  ‘  ‘  +  CLn  =  Ofc- 

k=m 


The  infinite  series  an  sa^  to  converge  provided  the  sequence 

(sn)  of  partial  sums  converges  to  a  real  number  S,  in  which  case  we 
define  Y^=m  an  =  s-  Tllus 


OO 

y]  an  =  S  means  lim  sn 

n=m 


s 


or 


lim 

n— >•  oo 


E 

\k=m 


&k 


s. 


A  series  that  does  not  converge  is  said  to  diverge.  We  say  that 
Yl^Lm  an  diverges  to  +oo  and  we  write  Y^=m  an  =  +°°  provided 
lim  sn  =  +oo;  a  similar  remark  applies  to  — oo.  The  symbol  Y^=m 
has  no  meaning  unless  the  series  converges,  or  diverges  to  +oo  or 
— oo.  Often  we  will  be  concerned  with  properties  of  infinite  series 
but  not  their  exact  values  or  precisely  where  the  summation  begins, 
in  which  case  we  may  write  an  rather  than  a«- 
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If  the  terms  an  of  an  infinite  series  Y  an  are  all  nonnegative, 
then  the  partial  sums  (sn)  form  an  increasing  sequence,  so  Theo¬ 
rems  10.2  and  10.4  show  that  Y  an  either  converges,  or  diverges 
to  Too.  In  particular,  Y  \an\  is  meaningful  for  any  sequence  (an) 
whatever.  The  series  Y  an  is  said  to  converge  absolutely  or  to  be  ab¬ 
solutely  convergent  if  Y  \an\  converges.  Absolutely  convergent  series 
are  convergent,  as  we  shall  see  in  Corollary  14.7.  □ 


Example  1 

A  series  of  the  form  ar”n  f°r  constants  a  and  r  is  called  a 

geometric  series.  These  are  the  easiest  series  to  sum.  For  r  ^  1,  the 
partial  sums  sn  are  given  by 


Y,ark 

k= 0 


=  a- 


l  _  rn+l 

1  —  r 


(1) 


This  identity  can  be  verified  by  mathematical  induction  or  by  mul¬ 
tiplying  both  sides  by  1  —  r,  in  which  case  the  right  hand  side  equals 
a  —  arn+l  and  the  left  side  becomes 


(1-r)^2ark 
k= 0 


yark  -J2ark+l 

k= 0  fc=0 


=  a  +  ar  +  ar2  -\ - +  arn 


—  ( ar  T  ar 2  H - b  arn  +  arn+1 ) 


=  a  —  ar 


n+1 


For  |r|  <  1,  we  have  limn_>,00  rn+1  =  0  by  Theorem  9.7(b)  on  page  48, 
so  from  (1)  we  have  limn_>,00  sn  =  jY-  This  proves 

OO 

Y  arn  =  — — —  if  |r|  <  1.  (2) 

z— '  1  -  r 

n= 0 

If  a  ^  0  and  |r|  >  1,  then  the  sequence  ( arn )  does  not  converge  to 
0,  so  the  series  Y  ar n  diverges  by  Corollary  14.5  below.  □ 


Example  2 

Formula  (2)  of  Example  1  and  the  next  result  are  very  important 
and  both  should  be  used  whenever  possible,  even  though  we  will  not 
prove  (1)  below  until  the  next  section.  Consider  a  fixed  positive  real 
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number  p.  Then 


oo 


E 

n=  1 


1 

nP 


converges  if  and  only  if  p  >  1. 


(1) 


In  particular,  for  p  <  1,  we  can  write  E  l/np  =  +oo.  The  exact 
values  of  the  series  for  p  >  1  are  not  easy  to  determine.  Here  are 
some  remarkable  formulas  that  can  be  shown  by  techniques  [Fourier 
series  or  complex  variables,  to  name  two  possibilities]  that  will  not 
be  covered  in  this  text. 


E~i;?  =  T  =  1-6449-  (2) 

^i£  =  £  =  1-0823--.  (3) 

Similar  formulas  hold  for  EnLi  ~v  when  p  is  any  even  integer,  but 
no  such  elegant  formulas  are  known  for  p  odd.  In  particular,  no  such 
formula  is  known  for  EnLi  iH  though  of  course  this  series  converges 
and  can  be  approximated  as  closely  as  desired.  □ 


It  is  worth  emphasizing  that  it  is  often  easier  to  prove  limits  exist 

or  series  converge  than  to  determine  their  exact  values.  In  the  next 

section  we  will  show  without  much  difficulty  that  E  converges  for 

2 

all  p  >  1,  but  it  is  a  lot  harder  to  show  the  sum  is  ^  when  p  =  2 
and  no  one  knows  exactly  what  the  sum  is  for  p  =  3. 

14.3  Definition. 

We  say  a  series  E  an  satisfies  the  Cauchy  criterion  if  its  sequence 
(sn)  of  partial  sums  is  a  Cauchy  sequence  [see  Definition  10.8]: 

for  each  e  >  0  there  exists  a  number  N  such  that 

m,n  >  N  implies  |sn  —  sm|  <  e.  (1) 

Nothing  is  lost  in  this  definition  if  we  impose  the  restriction  n  >  m. 
Moreover,  it  is  only  a  notational  matter  to  work  with  m  —  1  where 
m  <  n  instead  of  m  where  m  <  n.  Therefore  (1)  is  equivalent  to 

for  each  e  >  0  there  exists  a  number  N  such  that 
n  >  m  >  N  implies  |sn  —  sm_i|  <  e. 


(2) 
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Since  sn  —  sm_i  =  Yk=maki  condition  (2)  can  be  rewritten 
for  each  e  >  0  there  exists  a  number  N  such  that 


n  >  m  >  N  implies 


X ak 

k=m 


<  e. 


(3) 


We  will  usually  use  version  (3)  of  the  Cauchy  criterion. 
Theorem  10.11  implies  the  following. 


14.4  Theorem. 

A  series  converges  if  and  only  if  it  satisfies  the  Cauchy  criterion. 


14.5  Corollary. 

If  a  series  Y  an  converges,  then  lima^  =  0. 

Proof 

Since  the  series  converges,  (3)  in  Definition  14.3  holds.  In  particu¬ 
lar,  (3)  in  14.3  holds  for  n  =  m;  i.e. ,  for  each  e  >  0  there  exists  a 
number  N  such  that  n>  N  implies  \an\  <  e.  Thus  liman  =  0.  ■ 


The  converse  of  Corollary  14.5  does  not  hold  as  the  example 
Y  l/n  =  +oo  shows. 

We  next  give  several  tests  to  assist  us  in  determining  whether  a 
series  converges.  The  first  test  is  elementary  but  useful. 

14.6  Comparison  Test. 

Let  Yan  be  a  series  where  an  >  0  for  all  n. 

(i)  IfY  an  converges  and  \bn\  <  an  for  all  n,  then  Y  bn  converges. 

(ii)  IfYan  =  +oo  and  bn  >  an  for  all  n,  then  Y^n  =  +oo. 

Proof 

(i)  For  n  >  m  we  have 

n  n  n 

X bk  -  XI  n  -  X  (1) 

k=m  k=m  k=m 

the  first  inequality  follows  from  the  triangle  inequality  [Ex¬ 
ercise  3.6(b)].  Since  Y  an  converges,  it  satisfies  the  Cauchy 
criterion  14.3(1).  It  follows  from  (1)  that  Y^n  also  satisfies 
the  Cauchy  criterion,  and  hence  Y  bn  converges. 
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(ii)  Let  (sn)  and  (tn)  be  the  sequences  of  partial  sums  for  Y  an  and 
Y  bn,  respectively.  Since  bn  >  an  for  all  n,  we  obviously  have 
tn  >  sn  for  all  n.  Since  limsn  =  +oo,  we  conclude  liin tn  = 
+oo,  i.e.,  Y  bn  =  +oo.  ■ 

14.7  Corollary. 

Absolutely  convergent  series  are  convergent .9 

Proof 

Suppose  Y  bn  is  absolutely  convergent.  This  means  Y  an  converges 
where  an  =  \bn\  for  all  n.  Then  \bn\  <  an  trivially,  so  Y  bn  converges 
by  14.6(i).  ■ 

We  next  state  the  Ratio  Test  which  is  popular  because  it  is  often 
easy  to  use.  But  it  has  defects:  It  isn’t  as  general  as  the  Root  Test. 
Moreover,  an  important  result  concerning  the  radius  of  convergence 
of  a  power  series  uses  the  Root  Test.  Finally,  the  Ratio  Test  is  worth¬ 
less  if  some  of  the  an’s  equal  0.  To  review  lim  sup’s  and  lim  inf’s,  see 
Definition  10.6,  Theorems  10.7  and  11.8,  and  §12. 

14.8  Ratio  Test. 

A  series  Y  an  of  nonzero  terms 

(i)  converges  absolutely  */ lim  sup  |an+i/an|  <  1, 

(ii)  diverges  li/liminf  |an+i/an|  >  1. 

(iii)  Otherwise  lirninf  \an+i/an\  <  1  <  limsup  |an+i/an|  and  the 
test  gives  no  information. 

We  give  the  proof  after  the  proof  of  the  Root  Test. 

Remember  that  if  lim  |an_|_i/an|  exists,  then  it  is  equal  to  both 
limsup  \an+\/an\  and  lirninf  \an+\/an\  and  hence  the  Ratio  Test  will 
give  information  unless,  of  course,  the  limit  lim  |an+i/an|  equals  1. 

14.9  Root  Test. 

Let  Yan  be  a  series  and  let  a  =  limsup  |an|1,/n.  The  series  Y  an 

(i)  converges  absolutely  if  a  <  1, 

(ii)  diverges  if  a  >  1. 


9 As  noted  in  [35],  the  proofs  of  this  corollary  and  the  Alternating  Series 
Theorem  15.3  use  the  completeness  of  M. 
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(iii)  Otherwise  a  =  1  and  the  test  gives  no  information. 

Proof 

(i)  Suppose  a  <  1,  and  select  e  >  0  so  that  a  +  e  <  1.  Then  by 
Definition  10.6  there  is  a  positive  integer  N  such  that 

a  —  e  <  sup{|an|1/,ri  :  n  >  ./V}  <  a  +  e. 

In  particular,  we  have  |an|ly/n  <  a  +  e  for  n  >  N,  so 

\an\  <  (a  +  e)n  for  n  >  N. 

Since  0  <  a  +  e  <  1,  the  geometric  series  X^Ar-t-i(a  +  e)?l  con" 
verges  and  the  Comparison  Test  shows  the  series  X^tv+i  a n 
also  converges.  Then  clearly  ^  an  converges;  see  Exercise  14.9. 

(ii)  If  a  >  1,  then  by  Theorem  11.7  a  subsequence  of  |a n |x/n  has 
limit  a  >  1.  It  follows  that  \an\  >  1  for  infinitely  many  choices 
of  n.  In  particular,  the  sequence  (an)  cannot  possibly  converge 
to  0,  so  the  series  an  cannot  converge  by  Corollary  14.5. 

(iii)  For  each  of  the  series  ~  and  ol  turns  out  to  equal  1 

as  can  be  seen  by  applying  Theorem  9.7(c)  on  page  48. 
Since  ^  -  diverges  and  ^  converges,  the  equality  a  =  1 
does  not  guarantee  either  convergence  or  divergence  of  the 
series.  ■ 


Proof  of  the  Ratio  Test 

Let  a  =  limsup  \an\l^n .  By  Theorem  12.2  we  have 


lim  inf 


®rt+ 1 
an 


<  a  <  limsup 


®n+ 1 


(1) 


If  limsup  |an+i/an|  <  1,  then  a  <  1  and  the  series  converges  by  the 
Root  Test.  If  lim  inf  \an+\/an\  >  1,  then  a  >  1  and  the  series  diverges 
by  the  Root  Test.  Assertion  14.8(iii)  is  verified  by  again  examining 
the  series  1/n  and  1/n2.  ■ 


Inequality  (1)  in  the  proof  of  the  Ratio  Test  shows  that  the  Root 
Test  is  superior  to  the  Ratio  Test  in  the  following  sense:  Whenever 
the  Root  Test  gives  no  information  [i.e.,  a  =  1]  the  Ratio  Test  will 
surely  also  give  no  information.  On  the  other  hand,  Example  8  below 
gives  a  series  for  which  the  Ratio  Test  gives  no  information  but 
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which  converges  by  the  Root  Test.  Nevertheless,  the  tests  usually 
fail  together  as  the  next  remark  shows. 

14.10  Remark. 

If  the  terms  an  are  nonzero  and  if  lim  |  an. |_i  jan  |  =  1 ,  then  a  = 
lim  sup  |  an  | 1//n  =  1  by  Corollary  12.3,  so  neither  the  Ratio  Test  nor 
the  Root  Test  gives  information  concerning  the  convergence  of  Y  an- 

We  have  three  tests  for  convergence  of  a  series  [Comparison,  Ra¬ 
tio,  Root],  and  we  will  obtain  two  more  in  the  next  section.  There  is 
no  clearcut  strategy  advising  us  which  test  to  try  first.  However,  if 
the  form  of  a  given  series  Y  an  does  not  suggest  a  particular  strat¬ 
egy,  and  if  the  ratios  an+i/an  are  easy  to  calculate,  one  may  as  well 
try  the  Ratio  Test  first. 

Example  3 

Consider  the  series 

3/  “  9  ~~  27  +  81~  243  +  ’”' 

n= 2  v  7 

This  is  a  geometric  series  and  has  the  form  YnLo  arTl  ^  we  W1’ite  if 
as  (1/9)  — 1/3)^.  Here  a  =  1/9  and  r  =  —1/3,  so  by  (2)  of 

Example  1  the  sum  is  (l/9)/[l  —  (—1/3)]  =  1/12. 

The  series  (1)  can  also  be  shown  to  converge  by  the  Comparison 
Test,  since  ^  l/3n  converges  by  the  Ratio  Test  or  by  the  Root  Test. 
In  fact,  if  an  =  (— l/3)n,  then  lim  | an+\ /an \  =  limsup  |an|1,/n  =  1/3. 
Of  course,  none  of  these  tests  will  give  us  the  exact  value  of  the 
series  (1).  □ 

Example  4 

Consider  the  series 

Tl 

!f  an  =  ,  then 

nz  +  3 

an- |_i  n  +  1  n2  +  3  n  + 1  n2  +  3 

an  (n  +  l)2  +  3  n  n  n2  +  2re  +  4’ 
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so  lim  |an+i/an|  =  1.  As  noted  in  14.10,  neither  the  Ratio  Test  nor 
the  Root  Test  gives  any  information  in  this  case.  Before  trying  the 
Comparison  Test  we  need  to  decide  whether  we  believe  the  series 
converges  or  not.  Since  an  is  approximately  1/n  for  large  n  and  since 
22(1  /n)  diverges,  we  expect  the  series  (1)  to  diverge.  Now 

n  n  n  1 

n2  +  3  —  n2  +  3n2  4n2  4n 

Since  22(l/n)  diverges,  ^2(l/4n)  also  diverges  [its  partial  sums  are 
sn/ 4  where  sn  =  22fc= i  (1/ A;)] ,  so  (1)  diverges  by  the  Comparison 
Test.  □ 


Example  5 

Consider  the  series 

ErfTT'  (1) 

As  the  reader  should  check,  neither  the  Ratio  Rest  nor  the  Root  Test 
gives  any  information.  The  nth  term  is  approximately  Aj  and  in  fact 
^q-j-  <  Since  22  converges,  the  series  (1)  converges  by  the 

Comparison  Test.  □ 


Example  6 

Consider  the  series 

(1) 

If  an  =  n/3n,  then  an+\/an  =  (n  +  l)/(3n),  so  lim|an+i/an|  = 
1/3.  Hence  the  series  (1)  converges  by  the  Ratio  Test.  In  this  case, 
applying  the  Root  Test  is  not  much  more  difficult  provided  we  recall 
limn1/Tl  =  1.  It  is  also  possible  to  show  (1)  converges  by  comparing 
it  with  a  suitable  geometric  series.  □ 


Example  7 

Consider  the  series 


(-l)n-3j  '  v  ' 

The  form  of  an  suggests  the  Root  Test.  Since  \an\l/n  =  1  for  even 
n  and  |an|1//n  =  1/2  for  odd  n,  we  have  a  =  limsup  |an|1//n  =  1. 


E 


a„  where  an  = 
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So  the  Root  Test  gives  no  information,  and  the  Ratio  Test  cannot 
help  either.  On  the  other  hand,  if  we  had  been  alert,  we  would  have 
observed  an  =  1  for  even  n,  so  (an)  cannot  converge  to  0.  Therefore 
the  series  (1)  diverges  by  Corollary  14.5.  □ 


Example  8 

Consider  the  series 


„  11  1  1  1 

2  2  _n  =  2  +  -  +  -  +  —  +  -  +  —  + 
n= 0 


16  8  64 


(1) 


Let  an  =  2(-1)n~n.  Since  an  <  for  all  n,  we  can  quickly  conclude 
the  series  converges  by  the  Comparison  Test.  But  our  real  interest  in 
this  series  is  that  it  illustrates  the  difference  between  the  Ratio  Test 
and  the  Root  Test.  Since  an+ \/an  =  1/8  for  even  n  and  an+\/an  =  2 
for  odd  n,  we  have 


1  ,.  -  r  an+ 1 

-  =  hm  mi  - 

8  an 


<  1  <  limsup 


®n+ 1 

Q"n 


=  2. 


Hence  the  Ratio  Test  gives  no  information. 

Note  that  (an)1//n  =  2"1  for  even  n  and  (a^)1/”  =  2"”1  for 
odd  n.  Since  lim2™  =  lim2_"  =  1  by  Theorem  9.7(d)  on  page  48, 
we  conclude  lim {an)l^n  =  Therefore  a  =  limsup(an)1/n  =  \  <  1 
and  the  series  (1)  converges  by  the  Root  Test.  □ 


Example  9 

Consider  the  series 


E 

n=  1 


(-i)n+1 

y/n 


=  1 


1  |  1 


1  (  i 

2  +  7! 


(i) 


Since  hm  y/n/(n  +  1)  =  1,  neither  the  Ratio  Test  nor  the  Root  Test 
gives  any  information.  Since  ^  ^  diverges,  we  will  not  be  able  to 
use  the  Comparison  Test  14.6(i)  to  show  (1)  converges.  Since  the 
terms  of  the  series  (1)  are  not  all  nonnegative,  we  will  not  be  able  to 
use  the  Comparison  Test  14.6(h)  to  show  (1)  diverges.  It  turns  out 
that  this  series  converges  by  the  Alternating  Series  Test  15.3  which 
we  have  deferred  to  the  next  section.  □ 
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Exercises 


14.1  Determine  which  of  the  following  series  converge.  Justify  your 


answers, 
(a)  £^ 
(0  £1- 
(e)  £^ 


(b)E£ 

(d)E^ 

(f)  En=2E^ 


14.2  Repeat  Exercise  14.1  for  the  following. 

(&)Et  (b)E(-D 

(c)E^  (d)E# 

(e)  E  yr  (f)  E 

(g)  ££ 


14.3  Repeat  Exercise  14.1  for  the  following. 

(a)E^r  (b)£^ 

(c)  Erk  (d)£(§)"(50+£) 

(e)Esin(^)  (f)E^ 

14.4  Repeat  Exercise  14.1  for  the  following. 

(a)  En=2  I^+FW  (b)  nV^TT-V^ 

(c) 

14.5  Suppose  £  an  =  A  and  £  bn  =  B  where  A  and  B  are  real  numbers. 
Use  limit  theorems  from  §9  to  quickly  prove  the  following. 


(a)  £(ttn  +  bn)  —  A  +  B. 

(b)  £  kan  =  kA  for  k  €  R. 

(c)  Is  £  anbn  =  AB  a  reasonable  conjecture?  Discuss. 

14.6  (a)  Prove  that  if  £  \an\  converges  and  (bn)  is  a  bounded  sequence, 

then  £  anbn  converges.  Hint:  Use  Theorem  14.4. 

(b)  Observe  that  Corollary  14.7  is  a  special  case  of  part  (a). 

14.7  Prove  that  if  £  an  is  a  convergent  series  of  nonnegative  numbers  and 
p  >  1,  then  £  a £  converges. 

14.8  Show  that  if  £  an  and  £  bn  are  convergent  series  of  nonnegative 
numbers,  then  £  \Janbn  converges.  Hint:  Show  y/anbn  <  an  +  bn  for 
all  n. 


14.9  The  convergence  of  a  series  does  not  depend  on  any  finite  number  of 
the  terms,  though  of  course  the  value  of  the  limit  does.  More  precisely, 
consider  series  £  an  and  £  bn  and  suppose  the  set  {n  S  N  :  an  ^  bn} 
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is  finite.  Then  the  series  both  converge  or  else  they  both  diverge. 
Prove  this.  Hint :  This  is  almost  obvious  from  Theorem  14.4. 

14.10  Find  a  series  E  an  which  diverges  by  the  Root  Test  but  for  which 
the  Ratio  Test  gives  no  information.  Compare  Example  8. 

14.11  Let  (an)  be  a  sequence  of  nonzero  real  numbers  such  that  the  sequence 

rati°s  is  a  constant  sequence.  Show  E  an  is  a  geometric 

series. 


14.12  Let  (a„)rieN  be  a  sequence  such  that  lim  inf  \an\  =  0.  Prove  there  is 
a  subsequence  {ank)keN  such  that  EfcLi  converges. 

14.13  We  have  seen  that  it  is  often  a  lot  harder  to  find  the  value  of  an 
infinite  sum  than  to  show  it  exists.  Here  are  some  sums  that  can  be 
handled. 


(a)  Calculate  £~=i(§)n  and  E~  iK)"- 

(b)  Prove  En=i  ^pr+TT  =  L  Hint '  Note  that  Ek=i  fc(FFiy  = 

V”  fi _ L_1 

Z^fc=ilfc  fc+iJ- 


(c)  Prove  E^Li  #i+t  =  Hint:  Note  p^r  =  p  -  p^. 

(d)  Use  (c)  to  calculate  E^Li  -pr- 

14.14  Prove  E^Li  n  diverges  by  comparing  with  the  series  E^L 2  where 

(a„)  is  the  sequence 


11111111111111111 
2 ’  4’  4’  8’  8’  8’  8’  16’  16’  16’  16’  16’  16’  16’  16’  32’  32’"‘'- 


§15  Alternating  Series  and  Integral  Tests 

Sometimes  one  can  check  convergence  or  divergence  of  series  by 
comparing  the  partial  sums  with  familiar  integrals.  We  illustrate. 


Example  1 

We  show  E  b  =  +00. 

Consider  the  picture  of  the  function  f(x)  =  -  in  Fig.  15.1.  For 
n  >  1  it  is  evident  that 


n 


E 


1 

k 


Sum  of  the  areas  of  the  first  n  rectangles  in  Fig.  15.1 
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>  Area  under  the  curve  —  between  1  and  n  +  1 

x 


—  dx 
x 


loge(n  +  1). 


Since  lim^^oo  loge(n  +  1)  =  +oo,  we  conclude  n  =  +°°- 

The  series  —  diverges  very  slowly.  In  Example  7  on  page  120, 
we  observe  Yln=i  n  approximately  loge  N  +  0.5772.  Thus  for  N  = 
1,000  the  sum  is  approximately  7.485,  and  for  N  =  1,000,000  the 
sum  is  approximately  14.393.  □ 


Another  proof  that  ^  —  diverges  was  indicated  in  Exercise  14.14. 
However,  an  integral  test  is  useful  to  establish  the  next  result. 


Example  2 

We  show  converges. 

Consider  the  graph  of  fix)  =  yy  in  Fig.  15.2.  Then  we  have 


k=  1 


Sum  of  the  areas  of  the  first  n  rectangles 


<  1  + 


=  2- 


1 

n 


<  2 


for  all  n  >  1.  Thus  the  partial  sums  form  an  increasing  sequence 
that  is  bounded  above  by  2.  Therefore  converges  and  its 
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y 


sum  is  less  than  or  equal  to  2.  Actually,  we  have  already  mentioned 

2 

[without  proof!]  that  the  sum  is  =  1.6449 

Note  that  in  estimating  YJk=i  J?  we  hid  not  simply  write 
YJk=l  J1  —  Jo  x7  hx,  even  though  this  is  true,  because  this  inte¬ 
gral  is  infinite.  We  were  after  a  finite  upper  bound  for  the  partial 
sums.  □ 

The  techniques  just  illustrated  can  be  used  to  prove  the  following 
theorem. 


15.1  Theorem. 

Jp  converges  if  and  only  if  p  >  1 . 


Proof 

Supply  your  own  picture  and  observe  that  if  p  >  1 ,  then 


1  + 


p  —  1 


1  - 


nP 


'-i 


<  1+ 


p  —  1 


P 

p  —  1 


Consequently  Yln=i  Jr  ^  <  +°°- 

Suppose  0  <  p  <  1.  Then  ~  for  all  n.  Since  J  diverges, 

we  see  that  -J;  diverges  by  the  Comparison  Test.  ■ 


15.2  Integral  Tests. 

Here  are  the  conditions  under  which  an  integral  test  is  advisable: 

(a)  The  tests  in  §14  do  not  seem  to  apply. 

(b)  The  terms  an  of  the  series  ^  an  are  nonnegative. 
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(c)  There  is  a  nice  decreasing  function  /  on  [1,  oo)  such  that  /(n)  = 
an  for  all  n  [f  is  decreasing  if  x  <  y  implies  f(x)  >  f(y)\. 

(d)  The  integral  of  /  is  easy  to  calculate  or  estimate. 

If  lirrijj^oo  J"  f(x)  dx  =  +oo,  then  the  series  will  diverge  just 
as  in  Example  1.  If  liriiy^oo  J”  f(x)  dx  <  +oo,  then  the  series  will 
converge  just  as  in  Example  2.  The  interested  reader  may  formulate 
and  prove  the  general  result  [Exercise  15.8].  □ 

The  following  result  enables  us  to  conclude  that  series  like 
2J  v  ^  converge  even  though  they  do  not  converge  absolutely.  See 
Example  9  in  §14. 

15.3  Alternating  Series  Theorem. 

If  a i  >02  >  ■  ■  ■  >  an  >  ■  ■  ■  >0  and  lim  an  =  0,  then  the  al¬ 
ternating  series  l)n+1an  converges.  Moreover,  the  partial  sums 
sn  =  Jfk=i(~l)k+lak  satisfy  |s  -  sn|  <  an  for  all  n. 

The  series  I)n&n  is  called  an  alternating  series  because  the 
signs  of  the  terms  alternate  between  +  and  — . 

Proof 

We  need  to  show  that  the  sequence  ( sn )  converges.  Note  that  the 
subsequence  (s 2n)  is  increasing  because  S2n+2  —  S2n  =  — «2n+2  + 
«2n+i  >  0.  Similarly,  the  subsequence  (s2n-i)  is  decreasing  since 
s 2n+l  —  S2n-1  =  02n+l  —  0-2 n  <  0.  We  claim 

S2m  <  S2n+1  for  all  TO,  71  £  N.  (1) 

First  note  that  S2n  <  S2n+i  for  all  re,  because  S2n+i—S2n  =  02n+i  >  0. 
If  m  <  re,  then  (1)  holds  because  S2m  <  s 2n  <  S2n+i-  If  m  >  re, 
then  (1)  holds  because  S2n+i  >  S2m+i  >  S2m-  Thanks  to  (1),  we 
see  that  (s 2n)  is  an  increasing  subsequence  of  (sn)  bounded  above 
by  each  odd  partial  sum,  and  (s2n+i)  is  a  decreasing  subsequence 
of  (sn)  bounded  below  by  each  even  partial  sum.  By  Theorem  10.2, 
these  subsequences  converge,  say  to  s  and  t.  Now 

t-  s  =  lim  s2n+i  -  lim  s2n  =  lim  (s2n+i  -  s2n)  =  lim  a2n+i  =  0, 

n— >oo  n— >•  oo  n— >•  oo  n^-oo 

so  s  =  t.  It  follows  that  limn  sn  =  s. 
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To  check  the  last  claim,  note  that  s2k  <  s  <  s2fc_|_i,  so  both 
S2fe+i-s  and  s-s2fc  are  clearly  bounded  by  s2fc+i-s2fc  =  a2k+i  <  a2k. 
So,  whether  n  is  even  or  odd,  we  have  |s  —  sn|  <  an.  ■ 


Exercises 


15.1  Determine  which  of  the  following  series  converge.  Justify  your 
answers. 


(a)  E 


(~i)n 

n 


(b)E 


(-I)""! 

2n 


15.2  Repeat  Exercise  15.1  for  the  following. 

(a)  (b)  UM^fT 

15.3  Show  J2n=2  n(iog  n)p  converges  if  and  only  if  p  >  1. 


15.4  Determine  which  of  the  following  series  converge.  Justify  your 


answers. 


(a)  E 
(c)  E 


OO  l 

n=2  y/n\ogn 

oo  l 

n— 4  n(log  n) (log  log  n) 


(b)  E^=2 
(d)  E~  2 


log  n 
n 

log  n 


15.5  Why  didn’t  we  use  the  Comparison  Test  to  prove  Theorem  15.1  for 
p  >  1? 

15.6  (a)  Give  an  example  of  a  divergent  series  E  an  for  which  Ean 

converges. 

(b)  Observe  that  if  E  an  is  a  convergent  series  of  nonnegative  terms, 
then  E  an  also  converges.  See  Exercise  14.7. 

(c)  Give  an  example  of  a  convergent  series  E  an  for  which  E  an 
diverges. 


15.7  (a)  Prove  if  ( an )  is  a  decreasing  sequence  of  real  numbers  and  if  E  an 
converges,  then  lim nan  =  0.  Hint :  Consider  |a,/v+i+aAr+2  +  -  •  •  + 
an\  for  suitable  N. 

(b)  Use  (a)  to  give  another  proof  that  E  n  diverges. 


15.8  Formulate  and  prove  a  general  integral  test  as  advised  in  15.2. 


§16  *  Decimal  Expansions  of  Real  Numbers 

We  begin  by  recalling  the  brief  discussion  of  decimals  in  Discus¬ 
sion  10.3.  There  we  considered  a  decimal  expansion  K.did2d3  ■  ■  •, 
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where  K  is  a  nonnegative  integer  and  each  digit  dj  belongs  to 
{0, 1,2,3, 4,  5, 6,  7, 8, 9}.  This  expansion  represents  the  real  number 


which  we  also  can  write  as 


n 


lim  sn  where 


Thus  every  such  decimal  expansion  represents  a  nonnegative  real 
number.  We  will  prove  the  converse  after  we  formalize  the  process 
of  long  division.  The  development  here  is  based  on  some  suggestions 
by  Karl  Stromberg. 

16.1  Long  Division. 

Consider  a/b  where  a  and  b  are  positive  integers.  Since  the  K  term 
above  causes  no  difficulty,  we  assume  a  <  b.  We  analyze  the  familiar 
long  division  process  which  gives  a  decimal  expansion  for  a/b.  Fig¬ 
ure  16.1  shows  the  first  few  steps  where  a  =  3  and  b  =  7.  If  we  name 
the  digits  d\,d2,d%,...  and  the  remainders  ri,  r2,  r3, . . .,  then  so  far 
d\  =  4,  d2  =  2  and  r\  =  2,  r2  =  6.  At  the  next  step  we  divide  7  into 
60  =  10  •  r2  and  obtain  60  =  7  •  8  +  4.  The  quotient  8  becomes  the 
third  digit  d 3,  we  place  the  product  56  under  60,  subtract  and  obtain 
a  new  remainder  4  =  r^.  That  is,  we  are  calculating  the  remainder 


.42  d3  dt  =  4  d2  =  2 
7|  3.0000 

2  8  rx  =  2 


20 

14  r2  =  6 
"60 


FIGURE  16.1 
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obtained  by  dividing  60  by  7.  Next  we  multiply  the  remainder  =  4 
by  10  and  repeat  the  process.  At  each  stage 

dn  €  {0,1,2,3,4,5,6,7,8,9} 
rn  =  10  •  rn_i  -  7  ■  dn 
0  <  rn  <  7. 

These  results  hold  for  n  =  1,2,...  if  we  set  tq  =  3.  In  general,  we 
set  rg  =  a  and  obtain 


dn  G  {0,1,2,3,4,5,6,7,8,9} 
vn  —  10  vn—\  b  •  dn 
0  <  rn  <  b. 

As  we  will  show,  this  construction  yields: 

a  d\  1  ri 

b  ~  10  +  10  T 


and 


a  d± 

b  =  Td  + 


+ 


10r 


1  rn 

f  10 n  b' 


(1) 

(2) 

(3) 


(4) 


(5) 


for  n  >  2.  Since  each  rn  is  less  than  b,  we  have  limn  -  =  0,  so  (5) 
shows 


a 

b 


OO  7 

E  ‘ 


3= 1 


10? 


thus  .d\d2d3  •  •  •  is  a  decimal  expansion  for  |. 

Now  Eq.  (4)  follows  from  n  =  10a  —  bd\ ,  and  we  will  verify  (5) 
by  mathematical  induction.  From  (2),  we  have 

_  1  7  ,4  rn+l 

fn+l  —  10^n  b(l n  .  i .  SO  —  an_)_i  T  , 

b  10  10  b 


Substituting  this  into  (5)  gives 


®  di  dn  dn-\- 1 

b  “  10  +  "  ’  +  10"  +  10"+!  10"+!  ~b 


1  r, i+i 


(6) 


i.e.,  (5)  holds  with  n  replaced  by  n  +  1.  Thus  by  induction,  (5)  holds 
for  all  n.  □ 
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16.2  Theorem. 

Every  nonnegative  real  number  x  has  at  least  one  decimal  expansion. 


Proof 

It  suffices  to  consider  x  in  [0, 1).  The  proof  will  be  similar  to  that  for 
results  in  16.1,  starting  with  Eqs.  (4)  and  (5)  in  its  proof.  We  will 
use  the  “floor  function”  |_  J  on  M,  where  [y\  is  defined  to  be  the 
largest  integer  less  than  or  equal  to  y,  for  each  y  G  M. 

Since  1  Ox  <  10,  we  can  write 


lOx  =  d\  +  x\  where  d\  =  [10xJ  and  x\  6  [0,1).  (1) 

Note  di  is  in  {0, 1,  2, 3, . . . ,  9}  since  lOx  <  10.  Therefore 

(2) 


d\  1 

"“To  +  ir1' 


Suppose,  for  some  n  >  1,  we  have  chosen  di,...,dn  in  {0, 1,2,3, 
. . . ,  9}  and  xi, . . . ,  xn  in  [0, 1)  so  that 


di 


dr 


x~w  +  '"  +  W  +  WXn- 


(3) 


Since  10xn  <  10,  we  can  write 


10xn  =  dn+ 1  +  xn+i  where  dn+ 1  =  [10xnJ,xn+i  G  [0, 1).  (4) 

Solving  for  xn  in  (4)  and  substituting  the  value  in  (3),  we  get 


_  d\  dn-\.\  1 

x  ~  io  ion+1  ion+1  Xn+ 1 

This  completes  the  induction  step.  Since  limn  1Q^+1  xn+i  =  0,  we 
conclude 


n+ 1 


dn 


JL 


o°  j 

E  ’ 


10^ 


x  =  lim  > 

n  J 

j= 1  3=1 

so  that  .d\d2ds  •  •  •  is  a  decimal  expansion  for  x. 


As  noted  in  Discussion  10.3,  1.000  •  •  •  and  0.999  •  •  •  are  decimal 
expansions  for  the  same  real  number.  That  is,  the  series 


1  +  0 ' 10_j 
i=i 


and  ^  9-10  J 
j=l 
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have  the  same  value,  namely  1.  Similarly,  2.75000  •  •  •  and  2.74999  •  •  • 
are  both  decimal  expansions  for  -j-  [Exercise  16.1].  The  next  theorem 
shows  this  is  essentially  the  only  way  a  number  can  have  distinct 
decimal  expansions. 

16.3  Theorem. 

A  real  number  x  has  exactly  one  decimal  expansion  or  else  x  has  two 
decimal  expansions,  one  ending  in  a  sequence  of  all  0 ’s  and  the  other 
ending  in  a  sequence  of  all  9 ’s. 

Proof 

We  assume  x  >  0.  If  x  has  decimal  expansion  J\.000  •  •  •  with  K  >  0, 
then  it  has  one  other  decimal  expansion,  namely  (K  —  1).999  •  •  •.  If 
x  has  decimal  expansion  K.d\d2d 3  ■  ■  •  dr000  •  •  •  where  dr  7^  0,  then  it 
has  one  other  decimal  expansion  K.d\d2d^  ■  ■  ■  (dr  —  1)9999  •  •  •.  The 
reader  can  easily  check  these  claims  [Exercise  16.2]. 

Now  suppose  x  has  two  distinct  decimal  expansions  K.d\d2d^  ■  ■  ■ 
and  L.eie2e3  •  •  •.  Suppose  K  <  L.  If  any  dj  <  9,  then  by  Exercise  16.3 
we  have 


x  <  K  +  9-10  J  =  K  +  1  <  L  <  x, 

i=i 

a  contradiction.  It  follows  that  x  =  K  +  1  =  L  and  its  decimal 
expansions  are  K. 999  •  •  •  and  (K  +  1).000  •  •  -.  In  the  remaining  case, 
we  have  K  =  L.  Let 


m  =  min-jj  :  dj  7^  ej}. 

We  may  assume  dm  <  em.  If  dj  <  9  for  any  j  >  m,  then  by 
Exercise  16.3, 


<K  +  J2  dj  ■  10_i  +  9  '  W~j  =  K  +  ^ZdJ-  10_i  +  10_m 

1=1  j=m+ 1  1=1 

m—  1  m 

=  K+J2ej-  10”j  +  dm  ■  10~m  +  10"m  <  K  +  ^ej  ■  10~j  <  x, 
1=1  1=1 
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a  contradiction.  Thus  dj  =  9  for  j  >  m.  Likewise,  if  ej  >  0  for  any 
j  >  m,  then 

m  m—  1 

x>K  +  J2  e3  ■  w~j  =  k+Y1  di  '  10_j  +  '  10~m 

j=i  i=i 

m— 1 

>  K  ■  10_i  +  ■  10"m  +  10"m 

J=1 

m  oo 

=  K  +  J]  dj  ■  10~j  +  ^  9  •  10“J  >  x, 

1=1  j=m+l 

a  contradiction.  So  in  this  case,  dj  =  9  for  j  >  m,  em  =  dm  +  1  and 
ej  =  0  for  j  >  m.  ■ 

16.4  Definition. 

An  expression  of  the  form 

K.d]d'2  ■  ■  ■  dedt+ 1  •  •  •  dg+r 

represents  the  decimal  expansion  in  which  the  block  dg+i  ■  ■  ■  di+r  is 
repeated  indefinitely: 

K.d\d2  ■  ■  ■  did?+i  ■  ■  ■  dn+rdi+i  ■  ■  ■  d£+rdi+i  ■  ■  ■  d^+rdi+ 1  •  •  •  d^+r 
We  call  such  an  expansion  a  repeating  decimal. 


Example  1 

Every  integer  is  a  repeating  decimal.  For  example,  17 
17.000  •  •  •.  Another  simple  example  is 


.8  =  .888  •  •  •  =  8  •  W~J 

i=i 


10 


5> 

3=0 


8  10 

To  ’  ¥ 


17.0  = 

8 

9' 

□ 


Example  2 

The  expression  3.967  represents  the  repeating  decimal  3.9676767  •  •  •. 
We  evaluate  this  as  follows: 

3.967  =  3  +  9  •  10"1  +  6  •  10"2  +  7  •  10"3  +  6  •  10-4  +  7  •  10"5  +  •  •  • 

OO 

=  3  +  9  •  10"1  +  67  •  10”3  ^(10_2y 

3=0 
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=  3  +  9-  10_1  +  67  -  1(T3 

_  3,928  _  1,964 
“  990  ““  495 


.  9  67 

3  +  —  + - 

10  990 


Thus  the  repeating  decimal  3.967  represents  the  rational  number 
.  Any  repeating  decimal  can  be  evaluated  as  a  rational  number 
in  this  way,  as  we’ll  show  in  the  next  theorem.  □ 


Example  3 

We  find  the  decimal  expansion  for  -y- .  By  the  usual  long  division 
process  in  16.1,  we  find 

—  =  1.571428571428571428571428571428571 
7 

i.e.,  y  =  1.571428.  To  check  this,  observe 


1.571428  =  1  +  571,428  •  1(T6  ^(10_6y  =  1  + 

l=o 


571,428 

999,999 


11 

T' 


□ 


Many  books  give  the  next  theorem  as  an  exercise,  probably  to 
avoid  the  complicated  notation.  If  the  details  seem  too  complicated 
to  you,  move  on  to  Examples  4-7. 

16.5  Theorem. 

A  real  number  x  is  rational  if  and  only  if  its  decimal  expansion  is 
repeating.  [  Theorem  16.3  shows  that  if  x  has  two  decimal  expansions, 
they  are  both  repeating] 

Proof 

First  assume  x  >  0  has  a  repeating  decimal  expansion  x  = 
K.d\d2  ■  ■  ■  didi+ 1  •  •  •  di+r.  Then 

i 

x  =  k  +  J2  (1j  ■ 10_i  +  w~£v 
i=i 


where 
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so  it  suffices  to  show  y  is  rational.  To  simplify  the  notation,  we  write 


V  —  -&i&2  ■  ■  ■  er. 


A  little  computation  shows 


y  =  J2eJ'10  J 

3= 1 


oo 


E<lir+ 

3=0 


r 


=  J2er^-j 

3=1 


10r 

ior  - 1 ' 


Thus  y  is  rational.  In  fact,  if  we  write  eie2  ■  ■  ■  er  for  the  usual  decimal 
E'=(’  ej  '  10r_1_J  not  the  product ,  then  y  =  see  Example  3. 

Next  consider  any  positive  rational,  say  |  where  a,  b  6  N.  We 
may  assume  a  <  b.  As  we  saw  in  16.1,  |  is  given  by  the  decimal 
expansion  .444  ■  ■  •  where  ro  =  a, 


4  G  {0,1, 2, 3, 4,  5, 6,  7, 8, 9}  (1) 

rk  =  10  ■  rfc_i  -  dkb  (2) 

0  <rk  <b,  (3) 

for  k  >  1.  Since  a  and  6  are  integers,  each  is  an  integer.  Thus  (3) 
can  be  written 


rk  €  {0, 1, 2, . . . ,  b  —  1}  for  k>0.  (4) 

This  set  has  b  elements,  so  the  first  6  +  1  remainders  rk  cannot  all 
be  distinct.  That  is,  there  exist  integers  m  >  0  and  p  >  0  so  that 

0<m<m  +  p<6  and  rm  =  rm+p. 

From  the  construction  giving  (l)-(3)  it  is  clear  that  given  r^-i,  the 
integers  rk  and  4  are  uniquely  determined.  Thus 

rj=rk  implies  rj+1=rk+i  and  dj+±  =  4+1- 

Since  rm  =  rm+p,  we  conclude  rm+i  =  rrn+\+p  and  dm+1  =  dm+1+p. 
A  simple  induction  shows  that  the  statement 

rk  I'k+p  and  4  4+p 

holds  for  all  integers  k  >  m  +  1 .  Thus  the  decimal  expansion  of  |  is 
periodic  with  period  p  after  the  first  m  digits.  That  is, 


a 


•4  4  ■  ■  ■  4i4i+ 1  ■  ■  ■  dm+p. 
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Remark.  Given  r^-i,  the  uniqueness  of  r &  and  d *.  follows  from 
the  so-called  “division  algorithm,”  which  is  actually  a  theorem  that 
shows  the  algorithm  for  division  never  breaks  down.  It  says  that  if 
b  is  a  positive  integer  and  m  E  Z,  then  there  are  unique  integers  q 
and  r  so  that 

m  =  bq  +  r  and  0  <  r  <  6; 

q  is  called  the  quotient  and  r  is  called  the  remainder.  With  rn  = 
10  •  r^_ i  in  Theorem  16.5,  this  yields 

10  •  rk~  i  =  bq  +  r  where  0  <  r  <  b. 

If  we  name  q  =  d k  and  r  =  r^,  then  we  obtain  formula  (2)  in 
Theorem  16.5.  For  more  details,  see  for  example,  [60,  §3.5]. 

Example  4 

An  expansion  such  as 

.101001000100001000001000000100000001000000001000000000100- •  • 

represents  an  irrational  number,  since  it  cannot  be  a  repeating 
decimal:  we’ve  arranged  for  arbitrarily  long  blocks  of  0’s.  □ 

Example  5 

We  do  not  know  the  complete  decimal  expansions  of  y/2,  y/3  and 
many  other  familiar  irrational  numbers,  but  we  know  that  they 
cannot  be  repeating  by  virtue  of  the  last  theorem.  □ 

Example  6 

We  have  claimed  ir  and  e  are  irrational.  These  facts  and  many  others 
are  proved  in  a  fascinating  book  by  Ivan  Niven  [49]. 

(a)  Here  is  a  proof  that 


is  irrational.  Assume  e  =  |  where  a,  b  E  N.  Then  both  (6+l)!-e 
and  (b  +  1)!  •  ^  must  be  integers,  so  the  difference 

oo  1 

(6+1)!  £ 

k=b+ 2  K' 
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must  be  a  positive  integer.  On  the  other  hand,  this  last  number 
is  less  than 

1  1  |  1  |  _  bp2  _  1  ^  , 

6  +  2  +  (b  +  2)2  +  (b  +  2)3  +  "  '  “  l~r;  -  <  > 

a  contradiction. 

(b)  We  will  prove  7r2  is  irrational,  from  which  the  irrationality  of 
7 r  follows;  see  Exercise  16.10. 

The  key  to  the  proof  that  n2  is  irrational  is  the  sequence  of 
integrals  In  =  (-x(-7r~x'>'>  sin  xdx.  Thus 

In  = 

Claim  1.  There  is  a  sequence  (Qn)^Lo  °f  polynomials  with 
integer  coefficients,  of  degree  at  most  n,  satisfying  In  =  Qn{ tt2) 
for  all  n. 


Pn(x)  sin  x  dx  where  Pn(x)  = 


(x(tt  —  x))r 


n\ 


Proof.  First,  we  obtain  a  recursive  relation  for  In\  see  (3). 
We  use  integration  by  parts  (Theorem  34.2)  twice  to  show 

pTT  /*7T 

In  =  /  Pn  (x)  sin  x  dx  =  —  /  P”(x)smxdx  for  n  >  1. 

Jo  Jo 

(1) 

In  fact, 

r  7T  /*  7T 

/  Pn  (x)  sin  xdx  =  [—Pn  (tt)  COs(7r)  +  Pn  (0)  cos(0)]  +  /  Pn  (x)  COS  x  dx 
Jo  Jo 

/*7T 

=  /  P'n{x)  COS  xdx, 

Jo 

since  Pn(x)  contains  a  factor  of  x(7r  —  x)  which  is  0  at  both  7r 
and  0.  Therefore 

/*7 r 

In  =  P'n{x)cosxdx 
Jo 

=  [P'n^)  Sin(TT)  -  P'ni  °)  sin(0)]  “  [  Pn(x)  sin  *  dx 

Jo 

f‘7T 

=  —  Pn(x)  sin  x  dx, 
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and  (1)  holds.  For  n  >  2,  we  have 

K(X)  =  - NTj - ~  2x )  =  Pn-l(x){lT  -  2x), 

(n  —  1 ) ! 

so,  using  this  for  n  —  1  and  the  product  rule,  we  have 

P"(x)  =  Pn-2{x)(TT  -  2x )2  +  Pn- i(x)(-2) 

=  ir2Pn_2(x)  +  P„_2(x)(- 4nx  +  4x2)  -  2Pn_i(x). 

Since 

Pn_2(x)(-47rx  +  4x2)  =  =  —4  •  Pn_i  (x)  (n  —  1) , 

(n  —  2j! 

we  conclude 

P"{x)  =  v r2Pn_2(x)  -  [4(n  -  1)  +  2]Pn_i(x). 
Therefore 

P"(x)  =  7r2Pr),_2(x)  -  (4n  -  2)Pn_i(x)  for  n  >  2.  (2) 

To  prove  Claim  1,  note  that  Jo  =  2  is  clear.  Using  (1)  and 
P"{x)  =  —2,  we  see  that  I\  =  4.  And  from  (1)  and  (2),  we  see 
that 

In  =  -7 T2In-2  +  (4 n  -  2)/n_i  for  n  >  2.  (3) 

Now  Claim  1  holds  by  a  simple  induction  argument,  where 
Qo  =  2,  Qi  =  4,  and 

Qn(x)  =  -xQn-2(x)  +  (4n  -  2)Qn_i(x)  for  n  >  2. 


Claim  2.  7r2  is  irrational. 


Proof.  Suppose  7r2  =  a/6.  Using  Claim  1,  we  see  that 
each  bnIn  =  bnQn(a/b )  is  an  integer.  Since  x(i r  —  x)  takes  its 
maximum  at  7r/2,  we  can  write 


0  <  bnIn  =  bn 


<  br‘ 


(x(tt  -  x))n  . 
- : - sin  x  ax 


n\ 


(  7T  7T  \r 

v  2  '  2  / 


^^dx  = 

n\ 


bn2 

4 


■  7 T. 


n! 
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As  noted  in  Exercise  9.15,  the  right-hand  side  converges  to  0. 
So,  for  large  n,  the  integer  bnIn  lies  in  the  interval  (0, 1),  a 
contradiction. 

This  simplification  of  Ivan  Niven’s  famous  short  proof 
(1947)  is  due  to  Zhou  and  Markov  [72],  Zhou  and  Markov  use  a 
similar  technique  to  prove  tanr  is  irrational  for  nonzero  ratio¬ 
nal  r  and  cos  r  is  irrational  if  r2  is  a  nonzero  rational.  Compare 
with  results  in  Niven’s  book  [49,  Chap.  2], 

(c)  It  is  even  more  difficult  to  prove  n  and  e  are  not  algebraic 
numbers;  see  Definition  2.1.  These  results  are  proved  in  Niven’s 
book  [49,  Theorems  2.12  and  9.11].  □ 


Example  7 

There  is  a  famous  number  introduced  by  Euler  over  200  years  ago 
that  arises  in  the  study  of  the  gamma  function.  It  is  known  as  Euler’s 
constant  and  is  defined  by 


7  =  lim 

n— >oo 


E 

Lfc=l 


log  en 


Even  though 


1 

lim  >  —  =  +oo 

n—>oo  ^ 

k= 1 


and  lim  loge  n  =  +oo, 

n— >oo 


the  limit  defining  7  exists  and  is  finite  [Exercise  16.9].  In  fact,  7 
is  approximately  0.577216.  The  amazing  fact  is  that  no  one  knows 
whether  7  is  rational  or  not.  Most  mathematicians  believe  7  is  irra¬ 
tional.  This  is  because  it  is  “easier”  for  a  number  to  be  irrational, 
since  repeating  decimal  expansions  are  regular.  The  remark  in  Ex¬ 
ercise  16.8  hints  at  another  reason  it  is  easier  for  a  number  to  be 
irrational.  □ 


Exercises 

16.1  (a)  Show  2.749  and  2.750  are  both  decimal  expansions  for  ^ . 

(b)  Which  of  these  expansions  arises  from  the  long  division  process 
described  in  16.1? 
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16.2  Verify  the  claims  in  the  first  paragraph  of  the  proof  of  Theorem  16.3. 

16.3  Suppose  22  an  and  2Z  bn  are  convergent  series  of  nonnegative  num¬ 

bers.  Show  that  if  an  <  bn  for  all  n  and  if  an  <  bn  for  at  least  one  n, 
then  22  <  22  bn- 

16.4  Write  the  following  repeating  decimals  as  rationals,  i.e. ,  as  fractions 
of  integers. 


(a)  ,2_ 
(c)  .02 
(e)  .TO 


(b)  ,02_ 
(d)  3.14 
(f)  .1492 


16.5  Find  the  decimal  expansions  of  the  following  rational  numbers. 


(a)  1/8 
(c)  2/3 
(e)  6/11 


(b)  1/16 
(d)  7/9 
(f)  22/7 


16.6  Find  the  decimal  expansions  of  |.  |,  |  and  |.  Note  the 

interesting  pattern. 

16.7  Is  .1234567891011121314151617181920212223242526- ••  rational? 

16.8  Let  (s„)  be  a  sequence  of  numbers  in  (0,1).  Each  sn  has  a  decimal 
expansion  O.d^ ■■■.  For  each  n,  let  en  =  6  if  d ^  ^  6  and 
en  =  7  if  d^  =  6.  Show  .eie2e3  •  •  •  is  the  decimal  expansion  for 
some  number  y  in  (0, 1)  and  y  ^  sn  for  all  n.  Remark :  This  shows 
the  elements  of  (0, 1)  cannot  be  listed  as  a  sequence.  In  set-theoretic 
parlance,  (0, 1)  is  “uncountable.”  Since  the  set  Qn  (0, 1)  can  be  listed 
as  a  sequence,  there  are  a  lot  of  irrational  numbers  in  (0, 1)! 


(a)  Show  (7 n)  is  a  decreasing  sequence.  Hint:  Look  at  —  7^+1. 

(b)  Show  0  <  7„  <  1  for  all  n. 

(c)  Observe  that  7  =  lim„  7„  exists  and  is  finite. 

16.10  In  Example  6(b),  we  showed  ir2  is  irrational.  Use  this  to  show  n  is 
irrational.  What  can  you  say  about  yTr  and  tfn?  7r4? 
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CHAPTER 


Most  of  the  calculus  involves  the  study  of  continuous  functions. 
In  this  chapter  we  study  continuous  and  uniformly  continuous 
functions. 


§17  Continuous  Functions 

Recall  that  the  salient  features  of  a  function  /  are: 

(a)  The  set  on  which  /  is  defined,  called  the  domain  of  f  and 
written  dom (/); 

(b)  The  assignment,  rule  or  formula  specifying  the  value  f(x)  of  / 
at  each  x  in  dom(/). 

We  will  be  concerned  with  functions  /  such  that  dom(/)  C  M 
and  such  that  /  is  a  real-valued  function,  i.e. ,  f(x)  £  M  for  all 
x  £  dom(/).  Properly  speaking,  the  symbol  /  represents  the  function 
while  f{x)  represents  the  value  of  the  function  at  x.  However,  a  func¬ 
tion  is  often  given  by  specifying  its  values  and  without  mentioning  its 
domain.  In  this  case,  the  domain  is  understood  to  be  the  natural  do¬ 
main:  the  largest  subset  of  M  on  which  the  function  is  a  well  defined 
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real-valued  function.  Thus  “the  function  f(x)  =  1”  is  shorthand  for 
“the  function  /  given  by  f(x)  =  7  with  natural  domain  {x  G  M  : 
x  ^  0}.”  Similarly,  the  natural  domain  of  g(x)  =  \/4  —  x2  is  [—2,2] 
and  the  natural  domain  of  esc  x  =  p4-p  is  the  set  of  real  numbers  x 
not  of  the  form  mr,  n  G  Z. 

In  keeping  with  the  approach  in  this  book,  we  will  define  continu¬ 
ity  in  terms  of  sequences.  We  then  show  our  definition  is  equivalent 
to  the  usual  e — <5  definition. 

17.1  Definition. 

Let  /  be  a  real- valued  function  whose  domain  is  a  subset  of  M.  The 
function  /  is  continuous  at  xq  in  dom(/)  if,  for  every  sequence  (xn) 
in  dom(/)  converging  to  xo,  we  have  limn/(xn)  =  /(x o).  If  /  is 
continuous  at  each  point  of  a  set  S  C  dom (/),  then  /  is  said  to 
be  continuous  on  S.  The  function  /  is  said  to  be  continuous  if  it  is 
continuous  on  dom(/). 

Our  definition  implies  that  the  values  f(x)  are  close  to  /(x o) 
when  the  values  x  are  close  to  xq.  The  next  theorem  says  this  in 
another  way.  In  fact,  condition  (1)  of  the  next  theorem  is  the  e-5 
definition  of  continuity  given  in  many  calculus  books. 

17.2  Theorem. 

Let  f  be  a  real-valued  function  whose  domain  is  a  subset  o/M.  Then 
f  is  continuous  at  xq  in  dom (/)  if  and  only  if 

for  each  e  >  0  there  exists  6  >  0  such  that 
x  e  dom (/)  and  \x  —  xo\  <  5  imply  \f(x)  —  /(xo)|  <  e. 

(1) 

Proof 

Suppose  (1)  holds,  and  consider  a  sequence  (xn)  in  dom(/)  such  that 
lim xn  =  xq.  We  need  to  prove  lim  f{xn)  =  f(x o).  Let  e  >  0.  By  (1), 
there  exists  >  0  such  that 

x  G  dom(/)  and  \x  —  xq\  <  5  imply  |  f{x)  —  f(x o)|  <  e. 
Since  lirri xn  =  xo,  there  exists  N  so  that 

n  >  N  implies  \xn  —  xq\  <5. 
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It  follows  that 


n>N  implies  \f(xn)-f(x0)\<e. 

This  proves  lim  f(xn)  =  f(x o). 

Now  assume  /  is  continuous  at  xq,  but  (1)  fails.  Then  there  exists 
e  >  0  so  that  the  implication 

“x  G  dom(/)  and  \x  —  xo|  <  8  imply  |  f(x)  —  /(xo)|  <  e” 
fails  for  each  S  >  0.  In  particular,  the  implication 

“x  G  dom(/)  and  \x  —  x$\  <  —  imply  |  f(x)  —  f(x o)|  <  e” 

n 

fails  for  each  n  G  N.  So  for  each  n  G  N  there  exists  xn  in  dom (/)  such 
that  \xn — xo|  <  -  and  yet  \f(xo)  —  f(xn)\  >  e.  Thus  we  have  lim xn  = 
xq,  but  we  cannot  have  lim  f(xn)  =  f(x o)  since  |/(xo)  —  f(xn) \  >  e 
for  all  n.  This  shows  /  cannot  be  continuous  at  xq,  contrary  to  our 
assumption.  ■ 

As  the  next  example  illustrates,  it  is  sometimes  easier  to  work 
with  the  sequential  definition  of  continuity  in  Definition  17.1  than 
the  e—S  property  in  Theorem  17.2.  However,  it  is  important  to  get 
comfortable  with  the  e—S  property,  partly  because  the  definition  of 
uniform  continuity  is  more  closely  related  to  the  e—S  property  than 
the  sequential  definition. 

Example  1 

Let  f(x)  =  ‘lx1  +  1  for  x  G  M.  Prove  /  is  continuous  on  M  by 

(a)  Using  the  definition, 

(b)  Using  the  e—S  property  of  Theorem  17.2. 

Solution 

(a)  Suppose  lirri xn  =  xq.  Then  we  have 

lim/(xn)  =  lim[2x^  +  1]  =  2[limxn]2  +  1  =  2xq  +  1  =  f(x0) 

where  the  second  equality  is  an  application  of  the  limit 
Theorems  9. 2-9.4.  Hence  /  is  continuous  at  each  xq  in  M. 

(b)  Let  xq  be  in  M  and  let  e  >  0.  We  want  to  show  \f(x)  —  f(xo)\  <  e 
provided  \x  —  xq\  is  sufficiently  small,  i.e.,  less  than  some  S.  We 
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observe 

I  f(x)  -  f(x0) |  =  \2x2  +  1  -  (2xq  +  1)|  =  \2x2  -  2xq\ 

=  2\x  —  Xq\  ■  \x  +  Xq\. 

We  need  to  get  a  bound  for  |x  +  xo|  that  does  not  depend  on  x. 
We  notice  that  if  \x  —  xq\  <  1,  say,  then  |x|  <  |xo|  +  l  and  hence 
\x  +  xq\  <  |x|  +  |x0|  <  2|xo|  +  1.  Thus  we  have 

I  f(x)  -  f(x0) |  <  2|x  -  x0|(2|x0|  +  1) 

provided  \x  —  xo|  <  1.  To  arrange  for  2|x  —  xo|(2|xo|  +  1)  <  e, 
it  suffices  to  have  \x  —  xq\  <  2(2|a;o|+i)  anc^  a^so  lx  —  xo|  <  1-  So 
we  put 

1  2(2|x0|  +  1)  / 

The  work  above  shows  \x  —  xq\  <6  implies  |  f(x)  —  /(xo)|  <  e, 
as  desired.  □ 

The  reason  that  solution  (a)  in  Example  1  is  so  much  easier  is 
that  the  careful  analysis  was  done  in  proving  the  limit  theorems  in  §9. 

Example  2 

Let  f(x)  =  x2sin(j:)  for  x  ^  0  and  /( 0)  =  0.  The  graph  of  / 
in  Fig.  17.1  looks  continuous.  Prove  /  is  continuous  at  0. 

Solution 

Let  e  >  0.  Clearly  | f(x)  —  /(0)|  =  |/(x)|  <  x2  for  all  x.  Since  we 
want  this  to  be  less  than  e,  we  set  5  =  \fe.  Then  \x  —  0|  <  5  implies 
x2  <  S2  =  e,  so 

\x  —  0|  <  5  implies  |  f(x)  —  /(0)|  <  e. 

Hence  the  e—5  property  holds  and  /  is  continuous  at  0.  □ 

In  Example  2  it  would  have  been  equally  easy  to  show  that  if 
limxn  =  0  then  lim/(xn)  =  0.  The  function  /  in  Example  2  is  also 
continuous  at  the  other  points  of  M;  see  Example  4. 

Example  3 

Let  f(x)  =  )  sin(^2 )  for  x  ^  0  and  /( 0)  =  0.  Show  /  is  discontinuous , 
i.e.,  not  continuous,  at  0. 
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FIGURE  17.1 


Solution 

It  suffices  for  us  to  find  a  sequence  (xn)  converging  to  0  such 
that  f(xn)  does  not  converge  to  /( 0)  =  0.  So  we  will  arrange 
for  -^-sin(-V)  =  —  where  xn  —*■  0.  Thus  we  want  sinf-^-)  =  1, 

Xn  v  Xn  '  Xn  v  Xn  ' 

=  2vr n  +  f ,  x\  =  or  Xn  =  ^2™+^'  Then  limah»  =  0  while 

lint  f(xn)  =  lim  X-  =  +00.  □ 

Let  /  be  a  real-valued  function.  For  k  in  R,  kf  signifies  the  func¬ 
tion  defined  by  ( kf)(x )  =  kf(x )  for  x  E  dom(/).  Also  |/|  is  the 
function  defined  by  |/|(x)  =  \f(x)\  for  x  E  dom(/).  Thus  if  /  is  given 
by  f(x)  =  sjx  —  \  for  x  >  0,  then  3/  is  given  by  (3 f)(x)  =  3y/x  —  12 
for  x  >  0,  and  |/|  is  given  by  |/|(x)  =  \yfx  —  4|  for  x  >  0.  Here  is  an 
easy  theorem. 
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17.3  Theorem. 

Let  f  be  a  real-valued  function  with  dom  (/)  CM.  If  f  is  continuous 
at  xq  in  dom(f),  then  \  f\  and  kf ,  i:6l,  are  continuous  at  xq. 

Proof 

Consider  a  sequence  (xn)  in  dom (/)  converging  to  xo-  Since  /  is 
continuous  at  xo,  we  have  lirn  f(xn)  =  f{x o).  Theorem  9.2  shows 
lim  kf{xn)  =  kf(xo).  This  proves  kf  is  continuous  at  xo- 

To  prove  |/|  is  continuous  at  xo,  we  need  to  prove  lim|/(xri)|  = 
|/(xo)|-  This  follows  from  the  inequality 

ll/(®n)|  -  \f{x0)\\  <  |/(xn)  -  / (x0) | ;  (1) 

see  Exercise  3.5.  [In  detail,  consider  e  >  0.  Since  lim  f(xn)  =  f(x o), 
there  exists  N  such  that  n  >  N  implies  |  f(xn)  —  /(x o)|  <  e.  So 

by  (i), 

n>N  implies  | |/(xn)|  -  |/(x0)||  <  e; 
thus  lim  |/(xn)|  =  |  f  (x0)  |  •]  ■ 

We  remind  readers  that  if  /  and  g  are  real-valued  functions,  then 
we  can  combine  /  and  g  to  obtain  new  functions: 

(/  +  g)(x)  =  f(x)  +  g(x );  fg(x)  =  f(x)g{x)] 

( f/a)(x )  =  g  o  f(x )  =  g(f(x)); 

ma x(f,g)(x)  =  max{/(x),g(x)};  nrin  (f,g){x)  =  nrin{/(x),  g{x)} 

The  function  go  f  is  called  the  composition  of  g  and  f.  Each  of  these 
new  functions  is  defined  exactly  where  they  make  sense.  Thus  the 
domains  of  f  +  g,  fg,  max(f,g)  and  min (f,g)  are  dom(/)  n  dom(g), 
the  domain  of  f  /g  is  the  set  dom (/)  n  {x  €E  dom(g)  :  g(x)  0}, 
and  the  domain  of  g  o  /  is  (x  G  dom(/)  :  /(x)  €E  dom(<7)}.  Note 
/  +  g  =  g  +  f  and  fg  =  gf  but  that  in  general  /  o  g  ±  g  o  /. 

These  new  functions  are  continuous  if  /  and  g  are  continuous. 

17.4  Theorem. 

Let  f  and  g  be  real-valued  functions  that  are  continuous  at  xo  in  M. 
Then 

(i)  /  +  g  is  continuous  at  xq; 

(ii)  fg  is  continuous  at  xq; 

(iii)  f  /g  is  continuous  at  xq  if  g(x o)  7^  0. 
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Proof 

We  are  given  that  xo  €  dom(/)  D  dom(gr).  Let  (xn)  be  a  sequence  in 
dom(/)  ndom(<7)  converging  to  xq.  Then  we  have  lim/(xn)  =  f(x o) 
and  lim<7(x„)  =  g(x o).  Theorem  9.3  shows 

lim(/  +  g)(xn)  =  lim[/(xn)  +  g(xn)]  =  lirn  f(xn)  +  lim  g(xn) 

=  fix  o)  +  g(x0)  =  (/  +  sO(x0), 


so  /  +  5  is  continuous  at  xq.  Likewise,  Theorem  9.4  implies  fg  is 
continuous  at  xq. 

To  handle  f/g  we  assume  g(x o)  ^  0  and  consider  a  sequence 
(xn)  in  dom(/)  n  {x  E  dom(g)  :  g{x)  0}  converging  to  xo-  Then 
Theorem  9.6  shows 


lim 


(xn)  =  lim 


f{xn) 

g(xn) 


fix  o) 
aix  o 


so  f/g  is  continuous  at  xq. 


17.5  Theorem. 

If  f  is  continuous  at  xq  and  g  is  continuous  at  fix o),  then  the 
composite  function  g  o  f  is  continuous  at  xo  . 

Proof 

We  are  given  that  xo  6  dom(/)  and  fix o)  E  dom(5).  Let  (xn)  be  a 
sequence  in  {x  E  dom(/)  :  /(x)  E  dom(gr)}  converging  to  xq.  Since  / 
is  continuous  at  xo,  we  have  lim  f{xn)  =  fix o).  Since  the  sequence 
ifixn ))  converges  to  fix  o)  and  g  is  continuous  at  fix  o),  we  also  have 
limg(/(xn))  =  gifix 0));  that  is,  lirri  go/(xn)  =  gof(x0).  Hence  gof 
is  continuous  at  xq.  ■ 


Example  4 

For  this  example,  let  us  accept  as  known  that  polynomial  functions 
and  the  functions  sinx,  cosx  and  ex  are  continuous  on  R.  Then 
4ex  and  |  sinx|  are  continuous  on  R  by  Theorem  17.3.  The  function 
sinx  +  4ex  +  x3  is  continuous  on  R  by  (i)  of  Theorem  17.4.  The 
function  x4sinx  is  continuous  on  R  by  (ii)  of  Theorem  17.4,  and 
(iii)  of  Theorem  17.4  shows  tanx  =  is  continuous  wherever 
cosx  7^  0,  i.e.,  at  all  x  not  of  the  form  mr  +  n  E  Z.  Theorem  17.5 
tells  us  esmx  and  cos(ex)  are  continuous  on  R;  for  example,  cos(e3;)  = 
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g  o  f(x)  where  f(x)  =  ex  and  g(x)  =  cosx.  Several  applications  of 
Theorems  17.3-17.5  will  show  x2  sin(^)  and  ^  sin(^y)  are  continuous 
at  all  nonzero  s  ini.  □ 

Example  5 

Let  /  and  g  be  continuous  at  xq  in  R.  Prove  max(/,  g)  is  continuous 
at  xq  •  □ 

Solution 

We  could  prove  this  using  Definition  17.1  or  the  e—5  condition  in 
Theorem  17.2.  However,  we  illustrate  a  useful  technique  by  reducing 
the  problem  to  results  we  have  already  established.  First,  observe 

ma x(/,s)  =  i(/  +  ff)+ 

which  shows  that  the  function  max(/,  g)  is  a  combination  of  func¬ 
tions  to  which  our  theorems  apply.  This  equation  holds  because 
max{a, b}  =  \{a  +  b)  +  ^\a  —  b\  is  true  for  all  a, b  €  R,  a  fact  which 
is  easily  checked  by  considering  the  cases  a  >  b  and  a  <  b.  By  The¬ 
orem  17.4(i),  f  +  g  and  f  —  g  are  continuous  at  xq.  Hence  \  f  —  g\ 
is  continuous  at  xo  by  Theorem  17.3.  Then  ^(/  +  g)  and  /  —  g\ 
are  continuous  at  xq  by  Theorem  17.3,  and  another  application  of 
Theorem  17.4(i)  shows  max(/,  g)  is  continuous  at  xq.  □ 


Exercises 

17.1  Let  f{x)  =  \J \  —  x  for  x  <  4  and  g{x)  =  x2  for  all  x  €  R. 

(a)  Give  the  domains  of  /  +  g,  fg ,  fog  and  go  f. 

(b)  Find  the  values  fog(0),  gof(0),  fog(l),  50/(1),  f  o  g(2)  and 
9°  f{ 2)- 

(c)  Are  the  functions  fog  and  50/  equal? 

(d)  Are  /  o  5(3)  and  g  o  /( 3)  meaningful? 

17.2  Let  fix)  =  4  for  x  >  0,  fix)  =  0  for  x  <  0,  and  gix)  =  x2  for  all  x. 
Thus  dom(/)  =  dom(ff)  =  R. 

(a)  Determine  the  following  functions:  /  +  5,  fg ,  /  o  5,  go  f.  Be 
sure  to  specify  their  domains. 

(b)  Which  of  the  functions  /,  5,  f  +  g,  fg,  fog,  go  f  is  continuous? 
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17.3  Accept  on  faith  that  the  following  familiar  functions  are  continuous 
on  their  domains:  sin  a:,  cos  a;,  ex,  2X .  logex  for  x  >  0,  xp  for  x  >  0 
[p  any  real  number] .  Use  these  facts  and  theorems  in  this  section  to 
prove  the  following  functions  are  also  continuous. 


(a) 

loge(l  +  cos4 

x) 

(b) 

[sin2  x  +  cos6 

xY 

(c) 

2x2 

(d) 

8X 

(e) 

tana;  for  x  ^ 

odd  multiple  of 

(f) 

a;sin(i)  for  x  ^  0 

(g) 

x2  sin(i)  for 

r/0 

(h) 

-  sin(Aj-)  for 

X  x  X*  ' 

x  Y  o 

17.4  Prove  the  function  yfx  is  continuous  on  its  domain  [0,  oo).  Hint-. 
Apply  Example  5  in  §8. 

17.5  (a)  Prove  that  if  m  £  N,  then  the  function  f(x)  =  xm  is  continuous 

on  R. 

(b)  Prove  every  polynomial  function  p(x)  =  ag  +  a\X  +  •  •  •  +  anxn 
is  continuous  on  R. 

17.6  A  rational  function  is  a  function  /  of  the  form  p/q  where  p  and  q  are 
polynomial  functions.  The  domain  of  /  is  {x  £  R  :  q{x)  Y  0}.  Prove 
every  rational  function  is  continuous.  Hint:  Use  Exercise  17.5. 

17.7  (a)  Observe  that  if  k  £  R,  then  the  function  g(x)  =  kx  is  continuous 

by  Exercise  17.5. 

(b)  Prove  |a;|  is  a  continuous  function  on  R. 

(c)  Use  (a)  and  (b)  and  Theorem  17.5  to  give  another  proof  of 
Theorem  17.3. 

17.8  Let  /  and  g  be  real-valued  functions. 

(a)  Show  mm(f,g)  =  \{f  +  g)  -  \\f  -  g\- 

(b)  Show  min(/,  g)  =  -  ma x(-/,  -g). 

(c)  Use  (a)  or  (b)  to  prove  that  if  /  and  g  are  continuous  at  xg  in 
R,  then  min(/,  g)  is  continuous  at  Xg. 
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17.9  Prove  each  of  the  following  functions  in  continuous  at  Xo  by  verifying 
the  e-6  property  of  Theorem  17.2. 

(a)  f(x)  =  x 2,  x0  =  2; 

(b)  f(x)  =  y/x,  x0  =  0; 

(c)  f(x)  =  xsin(b)  for  x  ^  0  and  /( 0)  =  0,  Xo  =  0; 

(d)  g{x)  =  x 3,  xq  arbitrary. 

Hint  for  (d):  x3  —  Zg  =  (x  —  Xo){x2  +  xqx  +  Xq). 

17.10  Prove  the  following  functions  are  discontinuous  at  the  indicated 
points.  You  may  use  either  Definition  17.1  or  the  e-6  property  in 
Theorem  17.2. 

(a)  f(x)  =  1  for  x  >  0  and  f(x)  =  0  for  x  <  0,  Xo  =  0; 

(b)  g[x)  =  sin(i)  for  x  ^  0  and  #(0)  =  0,  Xo  =  0; 

(c)  sgn(:r)  =  —  1  for  x  <  0,  sgn(x)  =  1  for  x  >  0,  and  sgn(0)  =  0, 
Xq  =  0.  The  function  sgn  is  called  the  signum  function;  note 
sgn(x)  =  !§y  for  x  ±  0- 

17.11  Let  /  be  a  real- valued  function  with  dom(/)  C  R.  Prove  /  is  con¬ 
tinuous  at  Xo  if  and  only  if,  for  every  monotonic  sequence  (xn)  in 
dom(/)  converging  to  x'o,  we  have  lim/(a;n)  =  f(x o).  Hint:  Don’t 
forget  Theorem  11.4. 

17.12  (a)  Let  /  be  a  continuous  real-valued  function  with  domain  (a,  b). 

Show  that  if  f(r)  =  0  for  each  rational  number  r  in  (a,  b),  then 
f(x)  =  0  for  all  x  £  (a,  b ). 

(b)  Let  /  and  g  be  continuous  real- valued  functions  on  (a,  b)  such 
that  f(r)  =  g(r)  for  each  rational  number  r  in  (a,b).  Prove 
f(x)  =  g{x)  for  all  x  £  (a,  b).  Hint:  Use  part  (a). 

17.13  (a)  Let  f(x)  =  1  for  rational  numbers  x  and  f(x)  =  0  for  irrational 

numbers.  Show  /  is  discontinuous  at  every  x  in  R. 

(b)  Let  h[x)  =  x  for  rational  numbers  x  and  h(x)  =  0  for  irrational 
numbers.  Show  h  is  continuous  at  x  =  0  and  at  no  other  point. 

17.14  For  each  nonzero  rational  number  x,  write  x  as  |  where  p,q  are 
integers  with  no  common  factors  and  q  >  0,  and  then  define  f(x)  = 
| .  Also  define  /( 0)  =  1  and  f(x)  =  0  for  all  x  £  R\Q.  Thus  f(x)  =  1 
for  each  integer,  /(|)  =  /(— |)  =  /( |)  =  •  •  •  =  |,  etc.  Show  /  is 
continuous  at  each  point  of  R  \  Q  and  discontinuous  at  each  point 
of  Q. 
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17.15  Let  /  be  a  real- valued  function  whose  domain  is  a  subset  of  R.  Show 
/  is  continuous  at  Xo  in  dom(/)  if  and  only  if,  for  every  sequence 
(xn)  in  dom(/)  \  {xo}  converging  to  x’o,  we  have  lim/(x„)  =  f(x o). 

17.16  The  postage-stamp  function  P  is  defined  by  P(x)  =  A  for  0  <  x  <  1 
and  P(x)  =  A  +  Bn  for  n  <  x  <  n  +  1.  The  definition  of  P  means 
that  P  takes  the  value  A  on  the  interval  [0, 1),  the  value  A  +  B  on 
the  interval  [1,2),  the  value  A  +  2 B  on  the  interval  [2,  3),  etc.  Here 
A  is  postage  needed  for  the  first  ounce,  and  B  is  the  postage  needed 
for  each  additional  ounce.  Show  P  is  discontinuous  at  every  positive 
integer.  Because  postage  rates  tend  to  increase  over  time,  A  and  B 
are  actually  functions. 


§18  Properties  of  Continuous  Functions 

A  real-valued  function  /  is  said  to  be  bounded  if  {/(x)  :  x  G  dom(/)} 
is  a  bounded  set,  i.e.,  if  there  exists  a  real  number  M  such  that 
|/(x)|  <  M  for  all  x  G  dom (/). 

18.1  Theorem. 

Let  f  be  a  continuous  real-valued  function  on  a  closed  interval  [a,  b\ . 
Then  f  is  a  bounded  function.  Moreover,  f  assumes  its  maximum 
and  minimum  values  on  [a,  b\;  that  is,  there  exist  xo,yo  in  [a,  6]  such 
that  /(x0)  <  f(x)  <  f(y0)  for  all  x  G  [a,  b]. 

Proof 

Assume  /  is  not  bounded  on  [a,  b\.  Then  to  each  n  G  N  there 
corresponds  an  xn  G  [a,b\  such  that  \f(xn)\  >  n.  By  the  Bolzano- 
Weierstrass  Theorem  11.5,  (xn)  has  a  subsequence  (xnk)  that 
converges  to  some  real  number  xq.  The  number  xo  also  must  be¬ 
long  to  the  closed  interval  [a,  b],  as  noted  in  Exercise  8.9.  Since  /  is 
continuous  at  xq,  we  have  lim^oo  f{xnk)  =  f{x o),  but  we  also  have 
linifc^oo  \f(xnk)\  =  +oo,  which  is  a  contradiction.  It  follows  that  /  is 
bounded. 

Now  let  M  =  sup {/(x)  :  x  G  [a,  6]};  M  is  finite  by  the  preced¬ 
ing  paragraph.  For  each  n  G  N  there  exists  yn  G  [a,  b]  such  that 
M  —  ■-  <  f(yn )  <  M.  Hence  we  have  lim  ,/'(yn)  =  M.  By  the 
Bolzano- Weierstrass  theorem,  there  is  a  subsequence  (ynfc)  of  (yn) 
converging  to  a  limit  yo  hr  [«,  b].  Since  /  is  continuous  at  yo,  we 
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have  f(y0)  =  lim*.^  f(ynk).  Since  (f(ynk))ke N  is  a  subsequence  of 
(f(yn))ne N,  Theorem  11.3  shows  limfe_>0 0f(ynk)  =  lim,woo  f(yn)  = 
M  and  therefore  f(yo)  =  M.  Thus  /  assumes  its  maximum  at  y o- 

The  last  paragraph  applies  to  the  function  — /,  so  —  /  assumes 
its  maximum  at  some  xo  E  [a,  b ].  It  follows  easily  that  /  assumes  its 
minimum  at  xq ;  see  Exercise  18.1.  ■ 

Theorem  18.1  is  used  all  the  time,  at  least  implicitly,  in  solv¬ 
ing  maximum-minimum  problems  in  calculus  because  it  is  taken  for 
granted  that  the  problems  have  solutions,  namely  that  a  continuous 
function  on  a  closed  interval  actually  takes  on  a  maximum  and  a 
minimum.  If  the  domain  is  not  a  closed  interval,  one  needs  to  be 
careful;  see  Exercise  18.3. 

Theorem  18.1  is  false  if  the  closed  interval  [a,  6]  is  replaced  by  an 
open  interval.  For  example,  f(x)  =  -  is  continuous  but  unbounded 
on  (0, 1).  The  function  x2  is  continuous  and  bounded  on  (—1, 1),  but 
it  does  not  have  a  maximum  value  on  (—1,1). 

18.2  Intermediate  Value  Theorem. 

If  f  is  a  continuous  real-valued,  function  on  an  interval  I ,  then  f  has 
the  intermediate  value  property  on  I:  Whenever  a,b  E  I ,  a  <  b  and  y 
lies  between  f(a)  and  f(b)  [i.e.,  f(a)  <  y  <  f(b)  or  f(b)  <  y  <  /(a)], 
there  exists  at  least  one  x  in  ( a,b )  such  that  f(x)  =  y. 


Proof 

We  assume  /(a)  <  y  <  f(b );  the  other  case  is  similar.  Let  S  = 
{x  E  [a,  b]  :  f{x)  <  y};  see  Fig.  18.1.  Since  a  belongs  to  S,  the  set 
S  is  nonempty,  so  xq  =  sup  S  represents  a  number  in  [a,b\.  For  each 
n  E  N,  xo  —  ^  is  not  an  upper  bound  for  S,  so  there  exists  sn  £  S 

-i 

such  that  xo  —  -  <  sn  <  xq.  Thus  lim sn  =  xq  and,  since  f(sn)  <  y 
for  all  n,  we  have 

f(x0)  =  lim/(sn)  <  y.  (1) 

Let  tn  =  min{6,  xo  +  -;}•  Since  xo  <  tn  <  xo  +  we  have  lim tn  =  xo- 
Each  tn  belongs  to  [a,  b]  but  not  to  S,  so  f(tn)  >  y  for  all  n.  Therefore 
we  have 

f(x0)  =  lim  / (tn)  >  y; 

this  and  (1)  imply  f(x o)  =  y.  ■ 
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18.3  Corollary. 

If  f  is  a  continuous  real-valued  function  on  an  interval  I,  then  the 
set  f(I)  =  {f(x)  :  x  £  1}  is  also  an  interval  or  a  single  point. 

Proof 

The  set  J  =  /(/)  has  the  property: 

2/0, 2/1  €  J  and  2/0  <  2/  <  2/ 1  imply  y  €  J.  (1) 

If  inf  J  <  sup  J,  then  such  a  set  J  will  be  an  interval.  In  fact,  we  will 
show 

inf  J  <  y  <  sup  J  implies  y  £  J,  (2) 

so  J  is  an  interval  with  endpoints  inf  J  and  sup  J ;  inf  J  and  sup  J 
may  or  may  not  belong  to  J  and  they  may  or  may  not  be  finite. 

To  prove  (2)  from  (1),  consider  inf  J  <  y  <  supJ.  Then  there 
exist  yo,  2/1  hi  J  so  that  yo  <  y  <  yi-  Thus  y  £  J  by  (1).  ■ 

Example  1 

Let  /  be  a  continuous  function  mapping  [0,1]  into  [0,1].  In  other 
words,  dom(/)  =  [0, 1]  and  f(x)  £  [0, 1]  for  all  x  £  [0, 1].  Show  /  has 
a  fixed  point ,  i.e.,  a  point  xq  £  [0, 1]  such  that  f{x o)  =  xq\  xq  is  left 
“fixed”  by  /.  □ 
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Solution 

The  graph  of  /  lies  in  the  unit  square;  see  Fig.  18.2.  Our  assertion 
is  equivalent  to  the  assertion  that  the  graph  of  /  crosses  the  y  =  x 
line,  which  is  almost  obvious. 

A  rigorous  proof  involves  a  little  trick.  Consider  g(x)  =  f(x)  —  x 
which  is  also  a  continuous  function  on  [0, 1].  Since  g{ 0)  =  /( 0)  —  0  = 
/( 0)  >  0  and  g(  1)  =  /( 1)  —  1  <  1  —  1  =  0,  the  Intermediate  Value 
theorem  shows  g(x o)  =  0  for  some  xq  6  [0,1].  Then  obviously  we 
have  f(x o)  =  xo.  □ 

Example  2 

Show  that  if  y  >  0  and  m  £  N,  then  y  has  a  positive  mth  root.  □ 

Solution 

The  function  f(x)  =  xm  is  continuous  [Exercise  17.5].  There  exists 
b  >  0  so  that  y  <  bm\  in  fact,  if  y  <  1  let  b  =  1  and  if  y  >  1  let 
b  =  y.  Thus  /( 0)  <  y  <  f(b)  and  the  Intermediate  Value  theorem 
implies  f(x)  =  y  for  some  x  in  (0,6].  So  y  =  xm  and  x  is  an  mth 
root  of  y.  □ 

Let  us  analyze  the  function  f(x)  =  xm  in  Example  2  more  closely. 
It  is  a  strictly  increasing  function  on  [0,  oo): 

0  <  x\  <  X2  implies  x™  <  x™ . 
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Therefore  /  is  one-to-one  and  each  nonnegative  y  has  exactly  one 
nonnegative  mth  root.  This  assures  us  that  the  notation  y 1/m  is 
unambiguous.  In  fact,  f^1(y)  =  y is  the  inverse  function  of  / 
since  / ~1  o  f(x)  =  x  for  x  E  dom(/)  and  /  o  f^1(y)  =  y  for  y  E 
dom(/_1).  Since  f(x)  =  xm  is  continuous,  the  function  /_1(y)  = 
yi/m  jg  continuous  on  [0,  oo)  by  the  next  theorem.  Note  that  for 
m  =  2  this  result  appears  in  Exercise  17.4. 

18.4  Theorem. 

Let  f  be  a  continuous  strictly  increasing  function  on  some  interval 
I .  Then  f(I )  is  an  interval  J  by  Corollary  18.3  and  /-1  represents 
a  function  with  domain  J .  The  function  /-1  is  a  continuous  strictly 
increasing  function  on  J . 

Proof 

The  function  /-1  is  easily  shown  to  be  strictly  increasing.  Since  f~1 
maps  J  onto  /,  the  next  theorem  shows  /_1  is  continuous.  ■ 

18.5  Theorem. 

Let  g  be  a  strictly  increasing  function  on  an  interval  J  such  that  g(J) 
is  an  interval  I.  Then  g  is  continuous  on  J . 

Proof 

Consider  xo  in  J.  We  assume  xq  is  not  an  endpoint  of  J;  tiny  changes 
in  the  proof  are  needed  otherwise.  Then  g[x o)  is  not  an  endpoint  of 
/,  so  there  exists  eo  >  0  such  that  (g(x o)  —  eo,  <7(2:0)  +  eo)  7  I- 

Let  e  >  0.  Since  we  only  need  to  verify  the  e-8  property  of  The¬ 
orem  17.2  for  small  e,  we  may  assume  e  <  eo-  Then  there  exist 
X\,X2  E  J  such  that  g(x\)  =  <7(2:0)  —  e  and  <7(2:2)  =  <7(2:0)  +  £• 
Clearly  we  have  x\  <  xq  <  X2 ■  Also,  if  x\  <  x  <  X2,  then 
<7(2:1)  <  g(x)  <  <7(2:2),  hence  <7(2:0)  —  e  <  g(x)  <  <7(2:0)  +  e,  and  hence 
\g(x)  —  <7(2:0) |  <  e.  Now  if  we  put  S  =  min{x2  —  xq,  xo  —  2:1},  then 
\x  —  xo\  <  8  implies  x\  <  x  <  2:2  and  hence  \g{x)  —  <7(2:0) |  <  e.  ■ 

Theorem  18.5  provides  a  partial  converse  to  the  Intermediate 
Value  theorem,  since  it  tells  us  that  a  strictly  increasing  func¬ 
tion  with  the  intermediate  value  property  is  continuous.  However, 
Exercise  18.12  shows  that  a  function  can  have  the  intermediate  value 
property  without  being  continuous. 
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18.6  Theorem. 

Let  f  be  a  one-to-one  continuous  function  on  an  interval  I.  Then 
f  is  strictly  increasing  [xi  <  x 2  implies  f(x  1)  <  f{x 2)]  or  strictly 
decreasing  [xi  <  X2  implies  f(x  1)  >  f(x 2)]. 

Proof 

First  we  show 

if  a  <  b  <  c  in  I,  then  f(b)  lies  between  /(a)  and  /(c).  (1) 

If  not,  then  f(b)  >  max{/(a),  /(c)},  say.  Select  y  so  that  f(b)  >  y  > 
max{/(o), /(c)}.  By  the  Intermediate  Value  Theorem  18.2  applied 
to  [a,  b\  and  to  [6,  c],  there  exist  x\  G  (a,  b )  and  X2  €  ( b ,  c)  such  that 
f(x  1)  =  f(x 2)  =  y.  This  contradicts  the  one-to-one  property  of  /. 

Now  select  any  a 0  <  bo  in  I  and  suppose,  say,  that  /(ao)  <  f(bo). 
We  will  show  /  is  strictly  increasing  on  I.  By  (1)  we  have 

f(x)  <  /(ao)  for  x  <  ao  [since  x  <  ao  <  bo], 

/(ao)  <  f{x)  <  f(b0)  for  a0  <  x  <  b0, 

f(b 0)  <  f(x)  for  x  >  bo  [since  ao  <  bo  <  x\. 

In  particular, 

f(x)  <  f(a0)  for  all  x  <  a0,  (2) 

/(ao)  <  f(x)  for  all  x  >  a0.  (3) 

Consider  any  x\  <  X2  in  I.  If  x\  <  ao  <  X2,  then  f{x  1)  <  f(x 2) 

by  (2)  and  (3).  If  xx  <  x2  <  a0,  then  /(xi)  <  /(a0)  by  (2),  so  by  (1) 

we  have  /(x  1)  <  /(x 2).  Finally,  if  ao  <  xi  <  X2,  then  /(ao)  <  /(x 2), 
so  that  /(xi)  <  /(x 2).  ■ 


Exercises 

18.1  Let  /  be  as  in  Theorem  18.1.  Show  that  if  — /  assumes  its  maximum 
at  Xo  G  [a,  6],  then  /  assumes  its  minimum  at  Xo- 

18.2  Reread  the  proof  of  Theorem  18.1  with  [a,  b }  replaced  by  (a,  b).  Where 
does  it  break  down?  Discuss. 


18.3  Use  calculus  to  find  the  maximum  and  minimum  of  /(x)  =  x3  — 6x2  + 
9x  +  1  on  [0,  5). 


§19.  Uniform  Continuity  ^39 


18.4  Let  SCI  and  suppose  there  exists  a  sequence  (xn)  in  S  converging 
to  a  number  xq  £  S.  Show  there  exists  an  unbounded  continuous 
function  on  S. 

18.5  (a)  Let  /  and  g  be  continuous  functions  on  [a,  6]  such  that  /(a)  > 

g(a)  and  f(b)  <  g(b).  Prove  f(x o)  =  g(x o)  for  at  least  one  Xo  in 
[a,  b}. 

(b)  Show  Example  1  can  be  viewed  as  a  special  case  of  part  (a). 

18.6  Prove  x  =  cos  a;  for  some  x  in  (0,  |). 

18.7  Prove  xex  =  2  for  some  x  in  (0, 1). 

18.8  Suppose  /  is  a  real- valued  continuous  function  on  R  and  f(a)f(b)  <  0 
for  some  a,b  £  R.  Prove  there  exists  x  between  a  and  b  such  that 
f(x)  =  0. 

18.9  Prove  that  a  polynomial  function  /  of  odd  degree  has  at  least  one 
real  root.  Hint :  It  may  help  to  consider  first  the  case  of  a  cubic,  i.e. , 
f(x)  =  a,o  +  a\x  +  a,2X2  +  where  03  7^  0. 

18.10  Suppose  /  is  continuous  on  [0,2]  and  /( 0)  =  /( 2).  Prove  there  exist 
x,y  in  [0,2]  such  that  \y  —  x\  =  1  and  f(x)  =  f(y ).  Hint :  Consider 
g(x)  =  f  (x  +  1)  -  f(x)  on  [0, 1], 

18.11  (a)  Show  that  if  /  is  strictly  increasing  on  an  interval  /,  then  —  /  is 

strictly  decreasing  on  I. 

(b)  State  and  prove  Theorems  18.4  and  18.5  for  strictly  decreasing 
functions. 

18.12  Let  f(x)  =  sin(i)  for  x  7^  0  and  let  /( 0)  =  0. 

(a)  Observe  that  /  is  discontinuous  at  0  by  Exercise  17.10(b). 

(b)  Show  /  has  the  intermediate  value  property  on  R. 
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Let  /  be  a  real- valued  function  whose  domain  is  a  subset  of  M.  The¬ 
orem  17.2  tells  us  that  /  is  continuous  on  a  set  S  C  dom(/)  if  and 
only  if 

for  each  xq  €  S  and  e  >  0  there  is  6  >  0  so  that 
x  £  dom(/)  and  \x  —  xo|  <  5  imply  |  f{x)  —  f(x o)|  <  e. 

The  choice  of  5  depends  on  e  >  0  and  on  the  point  xq  in  S. 
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Example  1 

We  verify  (*)  for  the  function  f(x)  =  on  (0,oo).  Let  xq  >  0  and 
e  >  0.  We  need  to  show  \f(x)  —  f(x o)|  <  e  for  \x  —  xo|  sufficiently 
small.  Note  that 


f(x)  -  f(x0) 


1  1 

bl  ™  2 

dj  lb  Q 


rr 2  _  ~2 
lb  Q  Jb 

™2™2 
<X/  Ju  Q 


(X0  -  X)(X0  +  X) 

t2™2 
il/  Q 


(1) 


li\x  —  xq\  <  then  we  have  |x|  >  |x|  <  ^  and  \xq  +  x|  < 

These  observations  and  (1)  show  that  if  \x  —  xq|  <  ^ ,  then 


|/(x)  -  /(x0)|  < 


ko  -  a;  |  ■ 


10|xq  —  x\ 


xz 


Thus  if  we  set  5  =  rnin{^.  ^y},  then 


x  —  xq|  <  5  implies  |  f(x)  —  f(x o)|  <  e. 


This  establishes  (*)  for  /  on  (0,  oo).  Note  that  8  depends  on  both  e 
and  xq.  Even  if  e  is  fixed,  5  gets  small  when  xq  is  small.  This  shows 
that  our  choice  of  5  definitely  depends  on  xq  as  well  as  e,  though  this 
may  be  because  we  obtained  5  via  sloppy  estimates.  As  a  matter  of 
fact,  in  this  case  8  must  depend  on  xo  as  well  as  e;  see  Example  3. 
Figure  19.1  shows  how  a  fixed  e  requires  smaller  and  smaller  8  as  xq 
approaches  0.  [In  the  figure,  8\  signifies  a  8  that  works  for  x\  and  e, 
82  signifies  a  8  that  works  for  X2  and  e,  etc.]  □ 


It  turns  out  to  be  very  useful  to  know  when  the  8  in  condition 
(*)  can  be  chosen  to  depend  only  on  e  >  0  and  S,  so  that  8  does 
not  depend  on  the  particular  point  xq.  Such  functions  are  said  to 
be  uniformly  continuous  on  S.  In  the  definition,  the  points  x  and  xq 
play  a  symmetric  role,  so  we  will  call  them  x  and  y. 

19.1  Definition. 

Let  /  be  a  real- valued  function  defined  on  a  set  SCI,  Then  /  is 
uniformly  continuous  on  S  if 

for  each  e  >  0  there  exists  (5  >  0  such  that  ,  . 

x,y  6  S  and  \x  -  y\  <  8  imply  |  f(x)  -  f{y)\  <  e. 

We  will  say  /  is  uniformly  continuous  if  /  is  uniformly  continuous 
on  dom(/). 
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FIGURE  19.1 


Note  that  if  a  function  is  uniformly  continuous  on  its  domain, 
then  it  is  continuous  on  its  domain.  This  should  be  obvious;  if  it  isn’t, 
Theorem  17.2  and  Definition  19.1  should  be  carefully  scrutinized. 
Note  also  that  uniform  continuity  is  a  property  concerning  a  function 
and  a  set  [on  which  it  is  defined].  It  makes  no  sense  to  speak  of  a 
function  being  uniformly  continuous  at  each  point. 

Example  2 

We  show  f(x)  =  \  is  uniformly  continuous  on  any  set  of  the  form 
[a,  00)  where  a  >  0.  Here  a  is  fixed.  Let  e  >  0.  We  need  to  show  there 
exists  5  >  0  such  that 

x>a,  y  >  a  and  \x  -  y\  <  5  imply  \f(x)  -  f(y)\  <  e.  (1) 
As  in  formula  (1)  of  Example  1,  we  have 

{y-x)(y  +  x) 


f(x)  -  f(y) 


x2y2 
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If  we  can  show  is  bounded  on  [a,  oo)  by  a  constant  M .  then  we 
will  take  <5  =  jj.  But  we  have 

y  +  x  1  1  1  1  2 

x2y 2  x2y  xy2  ~  a3  a3  a 3  ’ 

3 

so  we  set  <5  =  4^-.  It  is  now  straightforward  to  verify  (1).  In  fact, 
x  >  a,  y  >  a  and  \x  —  y\  <  5  imply 


I /(*)  -  f(y) I 


\y-x\(y  +  x)\  ( J_  J_\  <  25 

x2y2  \x2y  xy2 )  ~  a3 


We  have  shown  /  is  uniformly  continuous  on  [a,  oo)  since  <5  depends 
only  on  e  and  the  set  [a,  oo).  □ 


Example  3 

The  function  f(x)  =  \  is  not  uniformly  continuous  on  the  set  (0,  oo) 
or  even  on  the  set  (0, 1). 

We  will  prove  this  by  directly  violating  the  definition  of  uni¬ 
form  continuity.  The  squeamish  reader  may  skip  this  demonstration 
and  wait  for  the  easy  proof  in  Example  6.  We  will  show  (1)  in 
Definition  19.1  fails  for  e  =  1;  that  is 


for  each  5  >  0  there  exist  x,  y  in  (0, 1)  such  that 
\x-y\  <6  and  yet  |  f(x)  -  f{y)  \  >  1. 


(1) 


[Actually,  for  this  function,  (1)  in  Definition  19.1  fails  for  all  e  >  0.] 
To  show  (1)  it  suffices  to  take  y  =  x  +  |  and  arrange  for 


/ 0)  -  / 


>  1. 


(2) 


[The  motivation  for  this  maneuver  is  to  go  from  two  variables,  x 
and  y,  in  (1)  to  one  variable,  x,  in  (2).]  By  (1)  in  Example  1,  (2)  is 
equivalent  to 


(x  +  |  -  x)(x  +  |  +  x)  _  S(2x  +  f ) 
x2(x  +  |)2  2x2(x  +  f  )2 


(3) 


It  suffices  to  prove  (1)  for  5  <  To  apply  (3),  let  us  try  x 
no  particular  reason.  Then 


<5(2<5  +  |)  5<52  /2  5  5  _  20 

2(52(<5  +  |)2  “  9<54/2  ~  952  >  9(Jj^  "  ~9 


5  for 
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We  were  lucky!  To  summarize,  we  have  shown  that  if  0  <  6  <  then 
|  f(6)  —  f(S  +  |)|  >  1,  so  (1)  holds  with  x  =  8  and  y  =  5  +  □ 

Example  4 

Is  the  function  f(x)  =  x 2  uniformly  continuous  on  [—7,  7]?  To  see  if  it 
is,  consider  e  >  0.  Note  that  \f(x)  —  f(y)\  =  \x2  —  y2\  =  \x-y\-\x+y\. 
Since  \x  +  y\  <  14  for  x,  y  in  [—7,  7],  we  have 

1/0*0  -f(y)\  <  !4|x-y|  for  x,y€[- 7,7]. 

Thus  if  <5  =  then 

x,ye[-7,7]  and  \x  -  y\  <  6  imply  \f(x)-f(y)\<e. 

We  have  shown  that  /  is  uniformly  continuous  on  [—7,7].  A  similar 
proof  would  work  for  f(x)  =  x2  on  any  closed  interval.  How¬ 
ever,  these  results  are  not  accidents  as  the  next  important  theorem 
shows.  □ 

19.2  Theorem. 

If  f  is  continuous  on  a  closed  interval  [ a,b ],  then  f  is  uniformly 
continuous  on  [a,  6] . 

Proof 

Assume  /  is  not  uniformly  continuous  on  [a,  b\.  Then  there  exists 
e  >  0  such  that  for  each  <5  >  0  the  implication 

“\x  —  y\  <5  implies  |  f(x)  -  f(y)\  <  e” 

fails.  That  is,  for  each  <5  >  0  there  exist  x,y  €  [a,b\  such  that  \x— y\  < 
5  and  yet  | f(x)  —  f(y)\  >  e.  Thus  for  each  n  6  N  there  exist  xn,yn 
in  [a,b\  such  that  \xn  -  yn\  <  ^  and  yet  \f{xn)  -  f(yn)\  >  e.  By 
the  Bolzano- Weierstr ass  Theorem  11.5,  a  subsequence  (xnk)  of  (xn) 
converges.  Moreover,  if  xq  =  lim^oo  xnk ,  then  xq  belongs  to  [a,  6]; 
see  Exercise  8.9.  Clearly  we  also  have  xq  =  Hindoo  ynk .  Since  /  is 
continuous  at  xo,  we  have 

f(x0)  =  lim  f(xnk)  =  lim  f(ynk ), 

K—>  oo  k—>  oo 

SO 

lim  [f{xnk)  -  f{ynk )]  =  0. 

k — yoo 

Since  | f(xnk)  —  f{ynk) I  >  e  for  all  fc,  we  have  a  contradiction.  We 
conclude  /  is  uniformly  continuous  on  [a,b\.  ■ 
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The  preceding  proof  used  only  two  properties  of  [a,b\: 

(a)  Boundedness,  so  the  Bolzano- Weierstrass  theorem  applies; 

(b)  A  convergent  sequence  in  [a,  b ]  converges  to  an  element  in  [a,  b\. 

As  noted  prior  to  Theorem  11.9,  sets  with  property  (b)  are  called 
closed  sets.  Hence  Theorem  19.2  has  the  following  generalization.  If 
f  is  continuous  on  a  closed  and  bounded  set  S,  then  f  is  uniformly 
continuous  on  S.  See  also  Theorems  21.4  and  13.12  that  appear  in 
enrichment  sections. 

Example  5 

In  view  of  Theorem  19.2,  the  following  functions  are  uniformly 
continuous  on  the  indicated  sets:  x 73  on  [—13,13],  y/x  on  [0,400], 


x17  sin(ex)  —  e4a:cos2x  on  [ — 87t,  87t] ,  and  ^  on  [|,44]. 


□ 


19.3  Discussion. 

Example  5  illustrates  the  power  of  Theorem  19.2,  but  it  still  may 
not  be  clear  why  uniform  continuity  is  worth  studying.  One  of  the 
important  applications  of  uniform  continuity  concerns  the  integrabil- 
ity  of  continuous  functions  on  closed  intervals.  To  see  the  relevance 
of  uniform  continuity,  consider  a  continuous  nonnegative  real- valued 
function  /  on  [0, 1].  For  n  €  N  and  i  =  0, 1,  2, . . . ,  n  —  1,  let 


Then  the  sum  of  the  areas  of  the  rectangles  in  Fig.  19.2a  equals 


rt. —  1 


2=0 

and  the  sum  of  the  areas  of  the  rectangles  in  Fig.  19.2b  equals 

n  —  1 


The  function  /  would  turn  out  to  be  Riemann  integrable  provided 
the  numbers  Un  and  Ln  are  close  together  for  large  n,  i.e. ,  if 


lim  (Un  -  Ln)  =  0; 


n— >■  oo 


(i) 
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see  Exercise  32.6.  Moreover,  we  would  have  f(x)dx  =  lim  Un  = 
limLn.  Relation  (1)  may  appear  obvious  from  Fig.  19.2,  but  uniform 
continuity  is  needed  to  prove  it.  First  note 

^  n—  1 

0  ^  Un  Ln  —  (Mi  n  ^z,n) 

i= 0 

for  all  n.  Let  e  >  0.  By  Theorem  19.2,  /  is  uniformly  continuous  on 
[0, 1],  so  there  exists  <5  >  0  such  that 

x,y€[ 0,1]  and  \x  -  y\  <  5  imply  \f(x)  -  f{y)\  <  e.  (2) 

Select  N  so  that  <  <5.  Consider  n  >  N ;  for  i  =  0, 1, 2, . . . ,  n  —  1, 
Theorem  18.1  shows  there  exist  in  [^,  satisfying  f{x{)  = 

mitn  and  f(yt )  =  M,;n.  Since  \  ^  <  <5,  (2)  shows 

Mi:n  -  mitn  =  f  {ui)  -  f(xi )  <  e, 


so 


0  <  —  Tn 


1  1  1 

~  ^  ^  1  Tfz?,  mi)n) 

n  i=0 


< 


1 

n 


n—  1 


2=0 


This  proves  (1)  as  desired. 


e. 


□ 


The  next  two  theorems  show  uniformly  continuous  functions  have 
nice  properties. 
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19.4  Theorem. 

If  f  is  uniformly  continuous  on  a  set  S  and  (sn)  is  a  Cauchy  sequence 
in  S,  then  ( f{sn ))  is  a  Cauchy  sequence. 

Proof 

Let  (sn)  be  a  Cauchy  sequence  in  S  and  let  e  >  0.  Since  /  is  uniformly 
continuous  on  S,  there  exists  8  >  0  so  that 

x,y  G  S  and  \x  -  y\  <  8  imply  \f(x)-f{y)\<e.  (1) 

Since  (sn)  is  a  Cauchy  sequence,  there  exists  N  so  that 

m,n>  N  implies  |sn  —  sm|  <  8. 

From  (1)  we  see  that 

m,n>  N  implies  | f(sn)  -  f(sm) \  <  e. 

This  proves  ( f{sn ))  is  also  a  Cauchy  sequence.  ■ 

Example  6 

We  show  f(x)  =  \  is  not  uniformly  continuous  on  (0, 1).  Let  sn  =  ^ 
for  n  E  N.  Then  (sn)  is  obviously  a  Cauchy  sequence  in  (0, 1).  Since 
f(sn)  =  n2,  (/(sn))  is  not  a  Cauchy  sequence.  Therefore  /  cannot 
be  uniformly  continuous  on  (0, 1)  by  Theorem  19.4.  □ 

The  next  theorem  involves  extensions  of  functions.  We  say  a 
function  /  is  an  extension  of  a  function  f  if 

dom(/)  C  dom(/)  and  f(x)  =  f(x)  for  all  x  €  dom (/). 

Example  7 

Let  f(x)  =  xsin(^)  for  x  €  (0,  -].  The  function  defined  by 

tt  \  /  ®sin(i)  for  0  <  x  <  \ 

/<I)=1  0  for  1  =  0 

is  an  extension  of  /.  Note  that  dom(/)  =  (0,  and  dom(/)  =  [0,  ^]. 
In  this  case,  /  is  a  continuous  extension  of  /.  See  Fig.  19.3  as  well  as 
Exercises  17.3(f)  and  17.9(c).  □ 
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FIGURE  19.3 

Example  8 

Let  g(x)  =  sin(-)  for  x  6  (0,  ^].  The  function  g  can  be  extended 
to  a  function  g  with  domain  [0,  -  in  many  ways,  but  g  will  not  be 
continuous.  See  Fig.  19.4.  □ 


The  function  /  in  Example  7  is  uniformly  continuous  [since  / 
is],  and  /  extends  to  a  continuous  function  on  the  closed  interval. 
The  function  g  in  Example  8  does  not  extend  to  a  continuous  func¬ 
tion  on  the  closed  interval,  and  it  turns  out  that  g  is  not  uniformly 
continuous.  These  examples  illustrate  the  next  theorem. 
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FIGURE  19.4 


19.5  Theorem. 

A  real-valued  function  f  on  (a,  b)  is  uniformly  continuous  on  (a,  b) 
if  and  only  if  it  can  be  extended  to  a  continuous  function  f  on  [a,  b\. 

Proof 

First  suppose  /  can  be  extended  to  a  continuous  function  /  on  [a,  b]. 
Then  /  is  uniformly  continuous  on  [a,  b]  by  Theorem  19.2,  so  clearly 
/  is  uniformly  continuous  on  (a,  b). 

Suppose  now  that  /  is  uniformly  continuous  on  (a,  b).  We  need  to 
define  /(a)  and  f(b)  so  that  the  extended  function  will  be  continuous. 
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It  suffices  for  us  to  deal  with  /(a).  We  make  two  claims: 

if  (sn)  is  a  sequence  in  (a,  b)  converging 
to  a,  then  (/(sn))  converges, 

and 

if  (sn)  and  (tn)  are  sequences  in  (a,  b )  converging 
to  a,  then  lim/(sn)  =  lim/(tn). 

Momentarily  accepting  (1)  and  (2)  as  valid,  we  define 

/(a)  =  lim/(sn)  for  any  sequence 
(sn)  in  (a,  6)  converging  to  a. 


(1) 

(2) 

(3) 


Assertion  (1)  guarantees  the  limit  exists,  and  assertion  (2)  guaran¬ 
tees  this  definition  is  unambiguous.  The  continuity  of  /  at  a  follows 
directly  from  (3);  see  Exercise  17.15. 

To  prove  (1),  note  that  (sn)  is  a  Cauchy  sequence,  so  ( f(sn ))  is 
also  a  Cauchy  sequence  by  Theorem  19.4.  Hence  ( f(sn ))  converges 
by  Theorem  10.11.  To  prove  (2)  we  create  a  third  sequence  (un)  such 
that  (sn)  and  (tn)  are  both  subsequences  of  (un).  In  fact,  we  simply 
interleaf  (sn)  and  (tn): 


(V'n')n= 1  S2,t2,  S3,t3,  S4,t4,  S5,t5, .  . 

It  is  evident  that  lim un  =  a,  so  lim  f(un)  exists  by  (1).  Theorem  11.3 
shows  the  subsequences  (/(sn))  and  ( f(tn ))  of  ( f(un ))  both  converge 
to  lim  f(un),  so  lim  f(sn)  =  lim  f{tn).  ■ 


Example  9 

Let  h(x)  =  for  i^O.  The  function  h  defined  on  M  by 


h(x) 


^  for  x^O 
1  for  r  =  0 


is  an  extension  of  h.  Clearly  h  and  h  are  continuous  at  all  x  ^  0.  It 
turns  out  that  h  is  continuous  at  x  =  0  [see  below] ,  so  h  is  uniformly 
continuous  on  (a,  0)  and  (0,  b )  for  any  a  <  0  <  b  by  Theorem  19.5. 
In  fact,  h  is  uniformly  continuous  on  K  [Exercise  19.11]. 

We  cannot  prove  the  continuity  of  h  at  0  in  this  book  because 
we  do  not  give  a  definition  of  sinx.  The  continuity  of  h  at  0  reflects 
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the  fact  that  sinx  is  differentiable  at  0  and  its  derivative  there  is 
cos(0)  =  1,  i.e., 

sin  x  —  sin  0  sin  x 

1  =  lim - =  lim - ; 

i->o  x  —  0  x->0  x 

see  Fig.  19.5.  The  proof  of  this  depends  on  how  sinx  is  defined; 
see  the  brief  discussion  in  37.12.  For  a  discussion  of  this  limit  and 
L’Hospital’s  rule,  see  Example  1  in  §30.  □ 

Here  is  another  useful  criterion  that  implies  uniform  continuity. 

19.6  Theorem. 

Let  f  be  a  continuous  function  on  an  interval  I  [I  may  be  bounded 
or  unbounded].  Let  1°  be  the  interval  obtained  by  removing  from  I 
any  endpoints  that  happen  to  be  in  I.  If  f  is  differentiable  on  I  and 
if  f  is  bounded  on  I  ,  then  f  is  uniformly  continuous  on  I . 

Proof 

For  this  proof  we  need  the  Mean  Value  theorem,  which  can  be  found 
in  most  calculus  texts  or  later  in  this  book  [Theorem  29.3]. 

Let  M  be  a  bound  for  f  on  I  so  that  | f'{x)\  <  M  for  all  x. 
Let  e  >  0  and  let  <5  =  -fj.  Consider  a,b  G  I  where  a  <  b  and 
\b  —  a|  <5.  By  the  Mean  Value  theorem,  there  exists  x  €  (a,  b )  such 
that  f'(x)  =  'f{b)bZfa(a) ,  so 

|/(6)  -  / (a) |  =  |/'(x)|  ■  |6  -  a|  <  M\b  -  a\  <  M6  =  e. 

This  proves  the  uniform  continuity  of  /  on  I.  ■ 
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Example  10 

Let  a  >  0  and  consider  f(x)  =  Since  f(x)  =  —  J|r  we  have 
|  f'(x)\  <  Jr  on  [a,  oo).  Hence  /  is  uniformly  continuous  on  [a,  oo)  by 
Theorem  19.6.  For  a  direct  proof  of  this  fact,  see  Example  2.  □ 


Exercises 

19.1  Which  of  the  following  continuous  functions  are  uniformly  continuous 
on  the  specified  set?  Justify  your  answers.  Use  any  theorems  you  wish. 

(a)  /(x)  =  x17  sinx  —  excos3x  on  [0, 7r], 

(b)  f(x)  =  x3  on  [0, 1], 

(c)  f(x)  =  x3  on  (0,1), 

(d)  /(x)  =  x3  on  R, 

(e)  f(x)  =  Jr  on  (0, 1], 

(f)  f(x)  =  sin  Jj  on  (0,1], 

(g)  f(x)  =  x2  sin  J  on  (0,1]. 

19.2  Prove  each  of  the  following  functions  is  uniformly  continuous  on  the 
indicated  set  by  directly  verifying  the  e-S  property  in  Definition  19.1. 

(a)  f(x)  =  3x  +  11  on  R, 

(b)  f(x)  =  x2  on  [0,3], 

(c)  f(x)  =  l  on  [§,oo). 

19.3  Repeat  Exercise  19.2  for  the  following. 

(a)  f(x)  =  on  [0,2], 

(b)  f(x)  =  2yri  on  [l,oo). 

19.4  (a)  Prove  that  if  /  is  uniformly  continuous  on  a  bounded  set  S, 

then  /  is  a  bounded  function  on  S.  Hint'.  Assume  not.  Use 
Theorems  11.5  and  19.4. 

(b)  Use  (a)  to  give  yet  another  proof  that  Jj-  is  not  uniformly 
continuous  on  (0, 1). 
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19.5  Which  of  the  following  continuous  functions  is  uniformly  continuous 
on  the  specified  set?  Justify  your  answers,  using  appropriate  theorems 
or  Exercise  19.4(a). 

(a)  tana:  on  [0,  J], 

(b)  tana;  on  [0,  |), 

(c)  ^  sin2  x  on  (0, 7r], 

(d)  5=3  on  (0,3), 

(e)  5=3  on  (3,  oo), 

(f)  on  (4,  oo). 

19.6  (a)  Let  f(x)  =  yfx  for  x  >  0.  Show  /'  is  unbounded  on  (0, 1]  but 

/  is  nevertheless  uniformly  continuous  on  (0,1).  Compare  with 
Theorem  19.6. 

(b)  Show  /  is  uniformly  continuous  on  [1,  oo). 

19.7  (a)  Let  /  be  a  continuous  function  on  [0,oo).  Prove  that  if  /  is 

uniformly  continuous  on  [ k ,  oo)  for  some  k ,  then  /  is  uniformly 
continuous  on  [0,oo). 

(b)  Use  (a)  and  Exercise  19.6(b)  to  prove  yfx  is  uniformly  continuous 
on  [0,  oo). 

19.8  (a)  Use  the  Mean  Value  theorem  to  prove 

|  sin  a;  —  sin  y\  <  \x  —  y\ 

for  all  x,y  in  R;  see  the  proof  of  Theorem  19.6. 

(b)  Show  sin  a;  is  uniformly  continuous  on  R. 

19.9  Let  f(x)  =  xsin(  J)  for  x  ^  0  and  /( 0)  =  0. 

(a)  Observe  /  is  continuous  on  R;  see  Exercises  17.3(f)  and  17.9(c). 

(b)  Why  is  /  uniformly  continuous  on  any  bounded  subset  of  R? 

(c)  Is  /  uniformly  continuous  on  R? 

19.10  Repeat  Exercise  19.9  for  the  function  g  where  g{x)  =  x2sin(~)  for 
x  ^  0  and  g{ 0)  =  0. 

19.11  Accept  the  fact  that  the  function  h  in  Example  9  is  continuous  on  R; 
prove  it  is  uniformly  continuous  on  R. 
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19.12  Let  /  be  a  continuous  function  on  [a,  6].  Show  the  function  /*  defined 
by  f*(x)  =  sup {f(y)  :  a  <  y  <  x},  for  x  G  [o,  6],  is  an  increasing 
continuous  function  on  [a,  6]. 


§20  Limits  of  Functions 

A  function  /  is  continuous  at  a  point  a  provided  the  values  f(x)  are 
near  the  value  /(a)  for  x  near  a  [and  x  G  dom(/)].  See  Definition  17.1 
and  Theorem  17.2.  It  would  be  reasonable  to  view  /(a)  as  the  limit 
of  the  values  f(x),  for  x  near  a,  and  to  write  lirnx^a  f(x)  =  /(a).  In 
this  section  we  formalize  this  notion.  This  section  is  needed  for  our 
careful  study  of  derivatives  in  Chap.  5,  but  it  may  be  deferred  until 
then. 

We  will  be  interested  in  ordinary  limits,  left-handed  and  right- 
handed  limits  and  infinite  limits.  In  order  to  handle  these  various 
concepts  efficiently  and  also  to  emphasize  their  common  features, 
we  begin  with  a  very  general  definition,  which  is  not  a  standard 
definition. 

20.1  Definition. 

Let  S'  be  a  subset  of  M,  let  a  be  a  real  number  or  symbol  oo  or  — oo 
that  is  the  limit  of  some  sequence  in  S,  and  let  L  be  a  real  number 
or  symbol  +oo  or  — oo.  We  write  limT_^as  f{x)  =  L  if 

/  is  a  function  defined  on  S,  (1) 


and 

for  every  sequence  ( xn )  in  S  with  limit  a,  ,  , 

we  havelim^oo  f(xn)  =  L.  { 

The  expression  “lim3,_>.0s  f(x)”  is  read  “limit,  as  x  tends  to  a  along  S, 
of  f(x).” 

20.2  Remarks. 

(a)  From  Definition  17.1  we  see  that  a  function  /  is  continuous  at 
a  in  dom(/)  =  S  if  and  only  if  limx^.as  f(x)  =  f{a). 
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(b)  Observe  that  limits,  when  they  exist,  are  unique.  This  follows 
from  (2)  of  Definition  20.1,  since  limits  of  sequences  are  unique, 
a  fact  that  is  verified  at  the  end  of  §7.  □ 

We  now  define  the  various  standard  limit  concepts  for  functions. 

20.3  Definition. 

(a)  For  a£l  and  a  function  /  we  write  limx_>.a  f(x)  =  L  provided 
lima._).as  f{x)  =  L  for  some  set  S  =  J  \  {a}  where  J  is  an 
open  interval  containing  a.  limx_»a  f(x)  is  called  the  [two-sided] 
limit  of  f  at  a.  Note  /  need  not  be  defined  at  a  and,  even  if  / 
is  defined  at  a,  the  value  /(a)  need  not  equal  liinx^a  f(x).  In 
fact,  /(a)  =  limx^.a  f(x)  if  and  only  if  /  is  defined  on  an  open 
interval  containing  a  and  /  is  continuous  at  a. 

(b)  For  a  €  M  and  a  function  /  we  write  lima,_>.a+  f{x)  =  L  pro¬ 
vided  lim x^as  f{x)  =  L  for  some  open  interval  S  =  ( a,b ). 
limxH>a+  f(x)  is  the  right-hand  limit  of  f  at  a.  Again  /  need 
not  be  defined  at  a. 

(c)  For  a  e  M  and  a  function  /  we  write  limx^a-  f{x)  =  L  pro¬ 
vided  lim x.^as  f{x)  =  L  for  some  open  interval  S  =  (c,  a). 
limx_^a-  f{x)  is  the  left-hand  limit  of  fat  a. 

(d)  For  a  function  /  we  write  lim^;^.^  f(x)  =  L  provided 
lim f(x)  =  L  for  some  interval  S  =  (c,  oo).  Likewise, 
we  write  lim^-oo  f(x)  =  L  provided  lim^^ooS  f(x)  =  L  for 
some  interval  S  =  (— oo,b). 

The  limits  dehned  above  are  unique;  i.e. ,  they  do  not  depend  on 
the  exact  choice  of  the  set  S  [Exercise  20.19]. 

Example  1 

We  have  limx^.4  x 3  =  64  and  limx_>,2  b  =  b  because  the  functions  x3 

-|  X  Z 

and  -  are  continuous  at  4  and  2,  respectively.  It  is  easy  to  show 
limx_>0+  b  =  +°°  and  lim^Q-  ]  =  — oo;  see  Exercise  20.14.  It 
follows  that  limx_>.o  b  does  not  exist;  see  Theorem  20.10.  □ 

Example  2 

Consider  limx_>.2  xxI-2  ■  This  is  not  like  Example  1 ,  because  the  func¬ 
tion  under  the  limit  is  not  even  defined  at  x  =  2.  However,  we  can 
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rewrite  the  function  as 


x2  —  4 
x  —  2 


(x  —  2)(x  +  2) 
x  —  2 


x  +  2  for  2. 


Now  it  is  clear  that  limx_>2  ^3^  =  limI^2(s  +  2)  =  4.  We  should 
emphasize  that  the  functions  x  and  x  +  2  are  not  identical.  The 
domain  of  f(x)  =  XXZ<2  is  (~ oo,2)  U  (2,oo)  while  the  domain  of 
f(x)  =  x  +  2  is  M,  so  that  /  is  an  extension  of  /.  This  seems  like 
nitpicking  and  this  example  may  appear  silly,  but  the  function  /, 
not  /,  arises  naturally  in  computing  the  derivative  of  g(x)  =  x2  at 
x  =  2.  Indeed,  using  the  definition  of  derivative  we  have 


g\2)  =  lim 


g{x)  -  g( 2)  ..  x2  -  4 


x-2 


=  lim 

x—>'2  x  —  2 


so  our  modest  computation  above  shows  g'{ 2)  =  4.  Of  course,  this 
is  obvious  from  the  formula  g'(x )  =  2x,  but  we  are  preparing  the 
foundations  of  limits  and  derivatives,  so  we  are  beginning  with  simple 
examples.  □ 


Example  3 

Consider  limx^.i  ^xZi  •  We  employ  a  trick  that  should  be  familiar  by 
now;  we  multiply  the  numerator  and  denominator  by  y/x  +  1  and 
obtain 

y/x  —  l  _  (y/x  —  l)(y/x  +  l)  _  X~1  _  1 

x-l  (x  -  l)(y/x  +  1)  ( x-l)(y/x+l )  y/Z+1 

for  x  ^  1.  Hence  limx_^i  ^x_i  =  limx_^i  We  have  just 

laboriously  verified  that  if  h(x)  =  y/x,  then  h!{  1)  =  □ 

Example  4 

Let  f(x)  =  (x}2yi  for  x  /2.  Then  Hindoo  f(x)  =  limx_^_oo  f(x)  = 
0,  limx_^2+  f(x )  =  +°°  and  lima._>2-  f{x)  =  — oo. 

To  verify  lirn^oo  f(x)  =  0,  we  consider  a  sequence  (xn)  such 
that  limn_>,00  xn  =  +oo  and  show  limn_>,00  f(xn)  =  0.  This  will  show 
limj._j.ojjS  f(x)  =  0  for  S  =  (2,oo),  for  example.  Exercise  9.11  and 
Theorem  9.9  show  limn^.00(.xn  —  2)'J|  =  +oo,  and  then  Theorem  9.10 
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shows 

lim  f(xn)  =  lim  [xn  -  2)-3  =  0.  (1) 

n—>  oo  n—>  oo 

Here  is  a  direct  proof  of  (1).  Let  e  >  0.  For  large  n,  we  need  \xn  — 
2|~3  <  e  or  e_1  <  \xn  —  2|3  or  e-1/3  <  \xn  —  2|.  The  last  inequality 
holds  if  xn  >  e”1/3  +  2.  Since  lirn^oo  xn  =  +oo,  there  exists  N  so 
that 

n>  N  implies  xn  >  e-1/3  T  2. 

Reversing  the  algebraic  steps  above,  we  find 

n  >  N  implies  \xn  —  2|-3  <  e. 

This  establishes  (1). 

Similar  arguments  prove  lim^-oo  f(x)  =  0  and  limx_>.2+  f(x)  = 
Too.  To  prove  limx^2-  f(x)  =  — oo,  consider  a  sequence  (xn)  such 
that  xn  <  2  for  all  n  and  limn_).0O  xn  =  2.  Then  2  —  xn  >  0  for 
all  n  and  limn^.0O(2  —  xn)  =  0.  Hence  lim,woo(2  —  xn )3  =  0  by 
Theorem  9.4,  and  9.10  implies  limn_>00(2  —  xn)~3  =  Too.  It  follows 
[Exercise  9.10(b)]  that 

lim  f(xn)  =  lim  (xn  -  2)-3  =  -oo.  (2) 

n— >oo  n— >  oo 

This  proves  that  limx_^2s  f(x)  =  —°°  for  S  =  (~ oo,2),  so  that 
limx_;.2-  f(x )  =  —oo.  Of  course,  a  direct  proof  of  (2)  also  can  be 
given. 

The  limits  discussed  above  are  confirmed  in  Fig.  20.1.  □ 

We  will  discuss  the  various  limits  defined  in  Definition  20.3  fur¬ 
ther  at  the  end  of  this  section.  First  we  prove  some  limit  theorems 
in  considerable  generality. 

20.4  Theorem. 

Let  fi  and  fi  be  functions  for  which  the  limits  L\  =  limx_^as  fi(x) 
and  L2  =  limx_^as  f2(x)  exist  and  are  finite.  Then 

(i)  limx_>as(/i  T  f2){x)  exists  and  equals  L\  T  L2; 

(ii)  limx^as (/1  /2)(.t)  exists  and  equals  L1L2; 

(iii)  limx^.as(/i//2)(x)  exists  and  equals  L1/L2  provided  L2  7^  0 
and  /2(x')  7^  0  for  x  6  S. 
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FIGURE  20.1 


Proof 

The  hypotheses  imply  both  /i  and  f2  are  defined  on  S  and  a  is  the 
limit  of  some  sequence  in  S.  Clearly  the  functions  f\  +  f2  and  fif2 
are  defined  on  S  and  so  is  /1//2  if  f2{x)  7^  0  for  x  £  S. 

Consider  a  sequence  (xn)  in  S  with  limit  a.  By  hypotheses  we 
have  Li  =  lim^oo  fi{xn)  and  L2  =  lim^oo /2(xn).  Theorems  9.3 
and  9.4  now  show 


lim  (/1  +  f2){xn)  =  lint  fi(xn)  +  lim  f2(xn )  =  Lx  +  L2 

n— >00  n— >00  n— >•  oo 


and 


lim  {fif2)(xn) 

n— >00 


lim  fi(xn) 

.71^-00 


lim  f2(xn) 

.n^-oo 


L\L2. 


Thus  (2)  in  Definition  20.1  holds  for  f\  +  f2  and  f\  f2 ,  so  that  (i)  and 
(ii)  hold.  Likewise  (iii)  follows  by  an  application  of  Theorem  9.6.  ■ 


Some  of  the  infinite  variations  of  Theorem  20.4  appear  in  Exer¬ 
cise  20.20.  The  next  theorem  is  less  general  than  might  have  been 
expected;  Example  7  shows  why. 
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20.5  Theorem. 

Let  f  be  a  function  for  which  the  limit  L  =  lirnx^as  f(x)  exists  and 
is  finite.  If  g  is  a  function  defined  on  {f(x)  :i£S}U  {L}  that  is 
continuous  at  L,  then  lirrix^as  g  o  f(x)  exists  and  equals  g(L). 

Proof 

Note  g  o  /  is  defined  on  S  by  our  assumptions.  Consider  a  sequence 
(xn)  in  S  with  limit  a.  Then  we  have  L  =  limn_>.0O  f(xn).  Since  g  is 
continuous  at  L,  it  follows  that 

g(L)  =  lim  g{f{xn))  =  lint  go  f(xn). 

n— >-oo  n— >-oo 

Hence  limx^as  g  o  f(x)  =  g(L).  U 

Example  5 

If  /  is  a  function  for  which  the  limit  L  =  limx_>.a  f(x)  exists  and  is 
finite,  then  we  have  limx^.a  |/(x)|  =  \L\.  This  follows  immediately 
from  Theorem  20.5  with  g{x)  =  |cc|.  Similarly,  we  have  limx^a  e^x^  = 
eL  if  we  accept  the  fact  that  g(x)  =  ex  is  continuous  on  R.  □ 

Example  6 

If  /  is  a  function  for  which  limx^0+  fix )  =  0  and  lim^oo  f{x)  = 
f,  then  we  have  limx_>.0+  e^x>  =  e°  =  1,  lim^oo  =  e  2 , 

limx^0+ sin(/(x))  =  sin(O)  =  0  and  lim^oo  sin(/(x))  =  sin  y  =  1. 

□ 


Example  7 

We  give  an  example  to  show  continuity  of  g  is  needed  in  Theo¬ 
rem  20.5.  Explicitly,  we  give  examples  of  functions  /  and  g  such 
that  limx^o  f(x)  =  1,  limx_n  g(x)  =  4  and  yet  lirn^o  g  o  f(x)  does 
not  exist.  One  would  expect  this  limit  to  exist  and  to  equal  4,  but  in 
the  example  fix)  will  equal  1  for  arbitrarily  small  x  while  g{  1)  7^  4. 
The  functions  /  and  g  are  defined  by  f(x)  =  1  +  xsin  -  for  x  7^  0, 
g{x)  =  4  for  x  7^  1,  and  g{  1)  =  —4.  Clearly  lirn^o  f{x)  =  1  and 
limx-u  g(x)  =  4.  Let  xn  =  |  for  n  €  N.  Then  f{xn)  =  1  +  \  sin(^); 
hence  f(xn)  =  1  for  even  n  and  f{xn)  7^  1  for  odd  n.  Therefore 
g  o  f(xn)  =  —4  for  even  n  and  g  o  f(xn)  =  4  for  odd  n.  Since 
limn_>,00  xn  =  0,  we  conclude  limx_^o  9  0  fix )  does  not  exist.  □ 
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As  in  Theorem  17.2,  the  limits  defined  in  Definitions  20.1  and  20.3 
can  be  recast  to  avoid  sequences.  First  we  state  and  prove  a  typi¬ 
cal  result  of  this  sort.  Then,  after  Corollary  20.8,  we  give  a  general 
scheme  without  proof. 

20.6  Theorem. 

Let  f  be  a  function  defined  on  a  subset  S  ofR,  let  a  be  a  real  number 
that  is  the  limit  of  some  sequence  in  S,  and  let  L  be  a  real  number, 
then  limx^as  f(x)  =  L  if  and  only  if 

for  each  e  >  0  there  exists  8  >  0  such  that  .  . 

iGS  and  \x  —  a\  <  8  imply  \f(x)  —  L\  <  e. 

Proof 

We  imitate  our  proof  of  Theorem  17.2.  Suppose  (1)  holds,  and  con¬ 
sider  a  sequence  (xn)  in  S  such  that  lin^^oo  xn  =  a.  To  show 
limn_>.0O  f(xn)  =  L,  consider  e  >  0.  By  (1)  there  exists  <5  >  0  such 
that 


x  £  S  and  \x  —  a|  <  8  imply  |  f(x)  —  L\  <  e. 

Since  lim^-^  xn  =  a,  there  exists  a  number  N  such  that  n  >  N 
implies  \xn  —  a\  <  8.  Since  xn  6  S  for  all  n,  we  conclude 

n  >  N  implies  |  f{xn)  —  L\  <  e. 

Thus  lirn^oo  f(xn)  =  L. 

Now  assume  lima,_).as  f(x)  =  L,  but  (1)  fails.  Then  for  some  e  >  0 
the  implication 

“x  6  S  and  \x  —  a\  <  8  imply  \f(x)  —  L\  <  e” 

fails  for  each  8  >  0.  Then  for  each  n  6  N  there  exists  xn  in  S 
where  \xn  —  a\  <  -  while  |  f(xn)  —  L\  >  e.  Hence  (xn)  is  a  sequence 
in  S  with  limit  a  for  which  limn^oo  f(xn)  =  L  fails.  Consequently 
limx^as  f(x)  =  L  fails  to  hold.  ■ 

20.7  Corollary. 

Let  f  be  a  function  defined  on  J  \  {a}  for  some  open  interval  J 
containing  a,  and  let  L  be  a  real  number.  Then  limx^.a  f(x)  =  L  if 
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and  only  if 


for  each  e  >  0  there  exists  S  >  0  such  that 
0  <  \x  —  a|  <  6  implies  \  f(x)  —  L\  <  e. 


(1) 


20.8  Corollary. 

Let  f  be  a  function  defined  on  some  interval  ( a,b ),  and  let  L  be  a 
real  number.  Then  \iinx^a+  f{x)  =  L  if  and  only  if 


for  each  e  >  0  there  exists  6  >  0  such  that 
0  <  x  <  a  +  8  implies  \f(x)  —  L\  <  e. 


(1) 


20.9  Discussion. 

We  now  consider  limx^.s  f(x)  =  L  where  L  can  be  finite,  +oo  or 
— oo,  and  s  is  a  symbol  a,  a+,  a~ ,  oo  or  — oo  [here  a  E  M],  Note 
we  have  15  [=3-5]  different  sorts  of  limits  here.  It  turns  out  that 
limxH>s  f(x)  =  L  if  and  only  if 


for  each 


there  exists 


such  that 


implies 


(1) 


For  finite  limits  L,  the  first  and  last  blanks  are  filled  in  by  “e  >  0” 
and  “|  f(x)  —  L\  <  e.”  For  L  =  +oo,  the  first  and  last  blanks  are  filled 
in  by  “M  >  0”  and  “/(x)  >  M,”  while  for  L  =  —  oo  they  are  filled 
in  by  “M  <  0”  and  “/(x)  <  M.”  When  we  consider  lim X^af(x), 
then  /  is  defined  on  J\  {a}  for  some  open  interval  J  containing 
a,  and  the  second  and  third  blanks  are  filled  in  by  “<5  >  0”  and 
“0  <  \x  —  a\  <  <5.”  For  limx^.a+  f(x)  we  require  /  to  be  defined  on 
an  interval  (a,  b )  and  the  second  and  third  blanks  are  filled  in  by 
“ 8  >  0”  and  “a  <  x  <  a  +  8 .”  For  lim.,,^-  f(x)  we  require  /  to 
be  defined  on  an  interval  (c,  a)  and  the  second  and  third  blanks  are 
filled  in  by  “<5  >  0”  and  “a  —  8  <  x  <  a.”  For  lirn^oo  f(x)  we  require 
/  to  be  defined  on  an  interval  (c,  oo)  and  the  second  and  third  blanks 
are  filled  in  by  “a  <  oo  and  “a  <  x.”  A  similar  remark  applies  to 
lim^-oo  f(x). 

The  assertions  above  with  L  finite  and  s  equal  to  a  or  a+  are 
contained  in  Corollaries  20.7  and  20.8.  □ 


20.10  Theorem. 

Let  f  be  a  function  defined  on  J  \  {a}  for  some  open  interval 
J  containing  a.  Then  limx_>,a  f(x)  exists  if  and  only  if  the  limits 
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limx_>a+  f(x)  and  lim3,_>a-  f(x)  both  exist  and  are  equal,  in  which 
case  all  three  limits  are  equal. 

Proof 

Suppose  lim^a  f(x)  =  L  and  L  is  finite.  Then  (1)  in  Corol¬ 
lary  20.7  holds,  so  (1)  in  Corollary  20.8  obviously  holds.  Thus  we 
have  limx^a+  f(x)  =  L;  similarly  limx_>a-  f(x)  =  L. 

Now  suppose  limx_>a+  f(x)  =  limx_^a-  f(x)  =  L  where  L  is  finite. 
Consider  e  >  0;  we  apply  Corollary  20.8  and  its  analogue  for  a~  to 
obtain  <5i  >  0  and  82  >  0  such  that 

a  <  x  <  a  +  8\  implies  |  f(x)  —  L\  <  e 


and 


a  —  82  <  x  <  a  implies  |  f(x)  —  L\  <  e. 

If  8  =  min{<5i,  82} :  then 

0  <  \x  —  a|  <  d  implies  |/(a;)  —  L\  <  e, 

so  limx^a  f(x)  =  L  by  Corollary  20.7. 

Similar  arguments  apply  if  the  limits  L  are  infinite.  For  example, 


suppose  limx^a  f(x)  =  +00  and  consider  M  >  0.  There  exists  8  >  0 
such  that 

0  <  \x  —  a\  <  8 

implies 

fix)  >  M. 

(1) 

Then  clearly 

a  <  x  <  a  +  8 

implies 

fix)  >  M 

(2) 

and 

a  —  8  <  x  <  a 

implies 

fix)  >  M, 

(3) 

so  that  limx_j. 

a+  f(x)  =  lim^. 

-  fix)  = 

+00. 

As  a  last  example,  suppose  limx_^a+  f(x)  =  limx^a-  f(x)  =  +00. 
For  each  M  >  0  there  exists  <5i  >  0  so  that  (2)  holds,  and  there 
exists  82  >  0  so  that  (3)  holds.  Then  (1)  holds  with  8  =  min{<5i,  82]- 
We  conclude  limx^.a  f[x)  =  +00.  ■ 
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20.11  Remark. 

Note  limx_>._0O  f(x)  is  very  similar  to  the  right-hand  limits  lim3,_).a+ 
f(x).  For  example,  if  L  is  finite,  then  limx_>.a+  f(x)  =  L  if  and  only 
if 


for  each  e  >  0  there  exists  a  >  a  such  that  ,  . 

a  <  x  <  a  implies  |  f(x)  —  L |  <  e, 

since  a  >  a  if  and  only  if  a  =  a  +  5  for  some  8  >  0;  see  Corol¬ 
lary  20.8.  If  we  set  a  =  — oo  in  (1),  we  obtain  the  condition  (1)  in 
Discussion  20.9  equivalent  to  lima;_»._00  f(x)  =  L. 

In  the  same  way,  the  limits  lim^^oo  f(x)  and  lirnx^a-  f(x)  will 
equal  L  [L  finite]  if  and  only  if 


for  each  e  >  0  there  exists  a  <  a  such  that  ,  . 

a  <  x  <  a  implies  |  f(x)  —  L\  <  e. 

Obvious  changes  are  needed  if  L  is  infinite.  □ 


Exercises 

20.1  Sketch  the  function  f(x)  =  ZZ.  Determine,  by  inspection,  the  lim¬ 
its  lim^o af(x),  lima._K)+  f(x),  lim^o-  f{x),  limx_)._00  f(x)  and 
limx_j.o  f(x)  when  they  exist.  Also  indicate  when  they  do  not  exist. 

20.2  Repeat  Exercise  20.1  for  f(x)  = 

20.3  Repeat  Exercise  20.1  for  f{x)  =  See  Example  9  of  §19. 

20.4  Repeat  Exercise  20.1  for  f(x)  =  a;  sin 

20.5  Prove  the  limit  assertions  in  Exercise  20.1. 

20.6  Prove  the  limit  assertions  in  Exercise  20.2. 

20.7  Prove  the  limit  assertions  in  Exercise  20.3. 

20.8  Prove  the  limit  assertions  in  Exercise  20.4. 

20.9  Repeat  Exercise  20.1  for  f(x)  = 

20.10  Prove  the  limit  assertions  in  Exercise  20.9. 

20.11  Find  the  following  limits. 

(a)  limx_>.0  ^5^  (b)  limx_>6  ^zf"  ■.  b>  0 

(c)  limx_,.a  xxZa  Hint:  x3—a3  =  (x—a)(x2+ax+a2). 
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20.12  (a)  Sketch  the  function  f(x)  =  [x  —  1)  1(x  —  2)  2 . 

(b)  Determine  limx_>2+  fix),  lima,_>,2-  fix),  limx_>1+  fix)  and 
lim,,..,.!-  fix). 

(c)  Determine  \imx^.2  fix)  and  limx_»i  /( x)  if  they  exist. 

20.13  Prove  that  if  limx_»a  f(x)  =  3  and  lim X^.ag(x)  =  2,  then 

(a)  \imx^a[3fix)  +  gix)2]  =  13, 

(b)  limx_,.a  =  2 ; 

(c)  limx^a  ^3 fix)  +8g(x)  =  5. 

20.14  Prove  limx_>0+  -  =  +oo  and  limx^.0-  y  =  —  oo. 

20.15  Prove  linr^-oo  f{x)  =  0  and  limx_>2+  fix)  =  +oo  for  the  function 
/  in  Example  4. 

20.16  Suppose  the  limits  L\  =  limx_>a+  fiix)  and  L2  =  limx_>Q+  f2ix) 
exist. 

(a)  Show  if  fiix)  <  /2(a:)  for  all  x  in  some  interval  (a,  b),  then 
L\  <  L2. 

(b)  Suppose  that,  in  fact,  fiix)  <  /2(a:)  for  all  x  in  some  interval 
(a,  b).  Can  you  conclude  L 1  <  i2? 

20.17  Show  that  if  limx_>Q+  fiix)  =  limx_>0+  /3(x)  =  L  and  if  fiix)  < 
/2(x)  <  fzix)  for  all  x  in  some  interval  (a,  b),  then  limx_>Q+  /2(x)  = 
L.  This  is  called  the  squeeze  lemma.  Warning:  This  is  not  immediate 
from  Exercise  20.16(a),  because  we  are  not  assuming  limx_>Q+  /2(x) 
exists;  this  must  be  proved. 

20.18  Let  fix)  =  v'1+|?2~1-  for  x  7^  0.  Show  limx_>o  fix)  exists  and 
determine  its  value.  Justify  all  claims. 

20.19  The  limits  defined  in  Definition  20.3  do  not  depend  on  the  choice 
of  the  set  S.  As  an  example,  consider  a  <  bi  <  &2  and  suppose  / 
is  defined  on  (a,  &2).  Show  that  if  the  limit  limx_>Qs  f(x)  exists  for 
either  S  =  (a,  61)  or  S  =  (a,  62),  then  the  limit  exists  for  the  other 
choice  of  S  and  these  limits  are  identical.  Their  common  value  is 
what  we  write  as  limx_>£t+  fix). 

20.20  Let  /1  and  /2  be  functions  such  that  lim^as  fiix)  =  +00  and  such 
that  the  limit  L2  =  limx_>as  /2(o:)  exists. 

(a)  Prove  limx_>as(/i  +  /2)(x)  =  +00  if  L2  7^  —00.  Hint:  Use 
Exercise  9.11. 
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(b)  Prove  limx_).Qs(/i/2)(a:)  =  +oo  if  0  <  L-2  <  +oo.  Hint:  Use 
Theorem  9.9. 

(c)  Prove  limT^as  (f-\  f2)(x)  =  — oo  if  — oo  <  L2  <  0. 

(d)  What  can  you  say  about  lima.^as(/i/2)(x)  if  L2  =  0? 


§21  *  More  on  Metric  Spaces:  Continuity 

In  this  section  and  the  next  section  we  continue  the  introduction  to 
metric  space  ideas  initiated  in  §13.  More  thorough  treatments  appear 
in  [33,53]  and  [62].  In  particular,  for  this  brief  introduction  we  avoid 
the  technical  and  somewhat  confusing  matter  of  relative  topolo¬ 
gies  that  is  not,  and  should  not  be,  avoided  in  the  more  thorough 
treatments. 

We  are  interested  in  functions  between  metric  spaces  (S,  d )  and 
( S*,d *).  We  will  write  uf:S  ->  S*”  to  signify  dom(/)  =  S  and  / 
takes  values  in  S*,  i.e.,  f(x)  £  S*  for  all  s  £  S. 

21.1  Definition. 

Consider  metric  spaces  (S,  d)  and  ( S*,d *).  A  function  f:S  — >•  S*  is 
continuous  at  so  in  S  if 

for  each  e  >  0  there  exists  8  >  0  such  that  .  . 

d(s,  so)  <  8  implies  d*(f(s),f(s0))  <  e. 

We  say  /  is  continuous  on  a  subset  E  of  S  if  /  is  continuous  at  each 
point  of  E.  The  function  /  is  uniformly  continuous  on  a  subset  E  of 
S  if 

for  each  e  >  0  there  exists  8  >  0  such  that  ,  . 

s,t  £  E  and  d(s,  t)  <  8  imply  d*(f(s),  f(t ))  <  e. 

Example  1 

Let  S  =  S*  =  M  and  d  =  d*  =  dist  where,  as  usual,  dist(a,  b)  =  \a—b\. 
The  definition  of  continuity  given  above  is  equivalent  to  that  in  §17 
in  view  of  Theorem  17.2.  The  definition  of  uniform  continuity  is 
equivalent  to  that  in  Definition  19.1.  □ 
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Example  2 

In  several  variable  calculus,  real- valued  functions  with  domain  R2  or 
R3,  or  even  Rk,  are  extensively  studied.  This  corresponds  to  the  case 
S  =  Rk , 


d{x,y) 


(xj  yj)  > 

3= 1 


S*  =  R  and  d*  =  dist.  We  will  not  develop  the  theory,  but  gener¬ 
ally  speaking,  functions  that  look  continuous  will  be.  Some  examples 
on  R2  are  f(x i,x2)  =  x\  +  x2,  f(x i,x2)  =  x\xi\jx\  +  x\  +  1, 
f(x i,X2)  =  cos(xi  —  x|).  Some  examples  on  R3  are  g(a;i,  X2j  £3)  = 
x\  +  xl  +  x\,  g(x l,x2,x3)  =  X1X2  +  X1X3  +  X2x3,  fir(xi,x2,x3)  = 
exi+a;2  l0g(x|  +  2).  □ 


Example  3 

Functions  with  domain  M  and  values  in  R2  or  R3,  or  generally  Rfc, 
are  also  studied  in  several  variable  calculus.  This  corresponds  to  the 
case  S  =  R,  d  =  dist,  S*  =  Rk  and 


d*(x,  y) 


1  1/2 


-Vi? 


3= 1 


The  images  of  such  functions  are  what  nonmathematicians  often  call 
a  “curve”  or  “path.”  In  order  to  distinguish  a  function  from  its  image, 
we  will  adhere  to  the  following  terminology.  Suppose  7:  R  — y  Rk  is 
continuous.  Then  we  will  call  7  a  path ;  its  image  7(R)  in  Rfc  will  be 
called  a  curve.  We  will  also  use  this  terminology  if  7  is  defined  and 
continuous  on  some  subinterval  of  R,  such  as  [a,  b\;  see  Exercise  21.7. 

As  an  example,  consider  7  where  7 (t)  =  (cost, sin t).  This  func¬ 
tion  maps  R  onto  the  circle  in  R2  about  (0,0)  with  radius  1. 

More  generally  70 (f)  =  (acosf,  bsint)  maps  R  onto  the  ellipse  with 
2  2 

equation  ^  =  1;  see  Fig.  21.1. 


The  graph  of  an  ordinary  continuous  function  /:  R  — >  R  looks 
like  a  curve,  and  it  is!  It  is  the  curve  for  the  path  7 (f)  =  (f,  f(t)). 
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FIGURE  21.2 


Curves  in  R3  can  be  quite  exotic.  For  example,  the  curve  for  the 
path  h(t)  =  (cost,  sin t,  |)  is  a  helix.  See  Fig.  21.2.  □ 

We  did  not  prove  that  any  of  the  paths  above  are  continuous, 
because  we  can  easily  prove  the  following  general  fact. 
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21.2  Proposition. 

Consider  a  function  7  :  [o,  b\  — >•  and  write 

'y(t)  =  (f1(t),f2(t),...,fk(t))  for  t  €  [a,  b\; 

thus  /i,/2,  are  real-valued  functions  on  [ a,b ].  Then  7  is 

continuous,  i.e.,  a  path,  if  and  only  if  each  fj  is  continuous. 

Proof 

Both  implications  follow  from  formula  (1)  in  the  proof  of  Lemma  13.3 
and  Exercise  13.2: 

\xj  —  yj\  <  d*(x,y)  <  Vkmax{\xj  -  y3 \  :  j  =  1, 2, . . . ,  k}.  (1) 

For  t,to  in  [a,  b],  (1)  implies 

-  /j(*o)|  <  d*('y(t),'y(t0))  for  j  =  l,...,k,  (2) 

and  d*(7(t),7(t0))  <  Vkmax{\fj(t)  -  fj(t0)\  :  j  =  1,2,..  ,,k}.  (3) 

Suppose  7  is  continuous  on  [a,b\,  and  consider  some  j  in 
{1,2,...,  k}.  To  show  fj  is  continuous  at  to  in  [a,  b] ,  given  e  >  0, 
select  6  >  0  so  that  d*( 7(t),7(to))  <  e  for  1 1  —  to  I  <  Then  by  (2), 

1 1  —  to |  <5  implies  |  fj(t)  —  fj(to)\  <  e.  So  fj  is  continuous  on  [a,  b\. 

Now  suppose  that  each  fj  is  continuous  on  [a,  b],  and  consider 
e  >  0.  For  each  j,  there  is  Sj  >  0  such  that 

1 1  -  t0 1  <  Sj  implies  |  fj(t)  -  fj(tQ)\  <  ~^=. 

For  5  =  min{(5i ,  Sr2,  ■  ■  ■ ,  S^}  and  \t  —  to |  <  S,  we  have 

max{|./j(t)  -  fj(t0) |  :  j  =  1,2,. . .  ,k}  <  ~^=, 

so  by  (3)  we  have  d*( 7(t),  7(to))  <  e.  Thus  7  is  continuous  at  to-  ■ 

The  next  theorem  shows  continuity  is  a  topological  property;  see 
Discussion  13.7. 

21.3  Theorem. 

Consider  metric  spaces  ( S,d )  and  ( S*,d *).  A  function  f:S  — »•  S*  is 
continuous  on  S  if  and  only  if 

f~l(U)  is  an  open  subset  of  S 
for  every  open  subset  U  of  S*. 


(1) 
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Recall  f  1(U)  =  {s  G  S  :  f(s)  G  £/}. 

Proof 

Suppose  /  is  continuous  on  S.  Let  U  be  an  open  subset  of  S*,  and 
consider  so  G  /-1(?7).  We  need  to  show  so  is  interior  to  /-1(f7). 
Since  /(so)  G  [/  and  £/  is  open,  we  have 

{s*  eS*  :d*(s*J(s0))  <e}CU  (2) 

for  some  e  >  0.  Since  /  is  continuous  at  so,  there  exists  S  >  0  such 
that 


d(s,s0)<5  implies  d*(f(s),f(s0))<e.  (3) 

From  (2)  and  (3)  we  conclude  d(s,  so)  <  <5  implies  f(s)  is  in  [/;  hence 
s  G  /_1([/).  That  is, 

{seS:d(s,s0)<5}Qf-1(U), 

so  that  so  is  interior  to  /_1(17). 

Conversely,  suppose  (1)  holds,  and  consider  so  G  S  and  e  >  0. 
Then  U  =  {s*  G  S*  :  d*(s*,f(so))  <  e}  is  open  in  S*,  so  f~1(U )  is 
open  in  S.  Since  so  G  /_1({7),  for  some  <5  >  0  we  have 

{s£S:d(s,s0)<6}Cf-\U). 


It  follows  that 

d(s,s0)  <  5  implies  d*(f(s),  f(s0))  <  e. 

Thus  /  is  continuous  at  sq-  ■ 


Continuity  at  a  point  is  also  a  topological  property;  see  Exer¬ 
cise  21.2.  Uniform  continuity  is  a  topological  property,  too,  but  if 
we  made  this  precise  we  would  be  led  to  a  special  class  of  topologies 
given  by  so-called  “uniformities.” 
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We  will  show  continuous  functions  preserve  two  important  topo¬ 
logical  properties:  compactness,  and  connectedness  which  will  be 
defined  in  the  next  section.  The  next  theorem  and  corollary  illustrate 
the  power  of  compactness. 

21.4  Theorem. 

Consider  metric  spaces  (S,d),  ( S*,d *)  and  a  continuous  function 
f:S S* .  Let  E  be  a  compact  subset  of  S.  Then 

(i)  f(E)  is  a  compact  subset  of  S* ,  and 

(ii)  f  is  uniformly  continuous  on  E. 

Proof 

To  prove  (i),  let  U  be  an  open  cover  of  f(E).  For  each  U  E  U,  f~l(U) 
is  open  in  S.  Moreover,  {/_1(17)  :  U  E  U}  is  a  cover  of  E.  Hence 
there  exist  U\,  U2,  ■  ■  ■ ,  Um  in  U  such  that 

e  c  r\u 1)  u  r\u2)  u  •  •  •  u  r\um). 

Then 

f{E)  C  lh  U  U2  U  ■  ■  ■  U  Um, 

so  {U\,  U2, . . . ,  Um}  is  the  desired  finite  subcover  of  U  for  f(E).  This 
proves  (i). 

To  establish  (ii),  let  e  >  0.  For  each  s  E  E  there  exists  5S  >  0 
[this  5  depends  on  s]  such  that 

d(s,t)  <  Ss  implies  d*(f(s),f(t))  <  |.  (1) 

For  each  s  E  E,  let  Vs  =  {t  E  S  :  d(s,t )  <  5^}.  Then  the  family 
V  =  {14  :  s  E  E}  is  an  open  cover  of  E.  By  compactness,  there  exist 
finitely  many  points  si,  S2,  ■  ■  ■ ,  sn  in  E  such  that 

ecvs1  uyS2u-ufv 

Let  <5=3  min{(5si,  SS2, . . . ,  <5Sn}.  We  complete  the  proof  by  showing 

s,t  E  E  and  d(s,t)  <  5  imply  d*(f(s),f(t))<e.  (2) 

For  some  k  in  {1, 2, . . . ,  n}  we  have  s  E  VSk ,  i.e.,  d(s,  Sk )  <  ^dSk.  Also 
we  have 

d(t,  sk)  <  d(t,  s )  +  d(s,  sk)  <  S  +  ~8Sk  <  8Sk. 
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Therefore  applying  (1)  twice  we  have 

|  and  d* (/(f),  f(sk))  < 

Hence  d*(f(s),f(t ))  <  e  as  desired.  ■ 

Assertion  (ii)  in  Theorem  21.4  generalizes  Theorem  19.2.  The 
next  corollary  should  be  compared  with  Theorem  18.1. 

21.5  Corollary. 

Let  f  be  a  continuous  real-valued  function  on  a  metric  space  ( S,d ). 
If  E  is  a  compact  subset  of  S,  then 

(i)  f  is  bounded  on  E, 

(ii)  /  assumes  its  maximum  and  minimum  on  E. 

Proof 

Since  f(E)  is  compact  in  R,  the  set  f(E)  is  bounded  by  Theo¬ 
rem  13.12.  This  implies  (i). 

Since  f(E)  is  compact,  it  contains  sup  f(E)  by  Exercise  13.13. 
Thus  there  exists  so  £  E  so  that  /(so)  =  sup  f(E).  This  tells  us 
/  assumes  its  maximum  value  on  E  at  the  point  so-  Similarly,  / 
assumes  its  minimum  on  E.  ■ 

Example  4 

All  the  functions  /  in  Example  2  are  bounded  on  any  compact  subset 
of  R2,  i.e. ,  on  any  closed  and  bounded  set  in  R2.  Likewise,  all  the 
functions  g  in  Example  2  are  bounded  on  each  closed  and  bounded 
set  in  R3.  □ 

Example  5 

Let  7  be  any  path  in  Rfc;  see  Example  3.  For  —oo<a<b<oo, 
the  image  7([a,  £>])  is  closed  and  bounded  in  M.k  by  Theorem  21.4. 
Note  Corollary  21.5  does  not  apply  in  this  case,  since  the  set  S*  in 
Theorem  21.4  is  Rfc,  not  R.  Theorem  21.4  also  tells  us  7  is  uniformly 
continuous  on  [a,  b\.  Thus  if  e  >  0,  there  exists  6  >  0  such  that 

s,t  €  [a,  6]  and  |s  —  t\  <  5  imply  d('y(s),'y(t))  <  e. 

This  fact  is  useful  in  several  variable  calculus,  where  one  integrates 
along  paths  7;  compare  Discussion  19.3.  □ 
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Example  6 

Consider  a  function  /  :  E  — >  R,  where  E  be  a  compact  subset  of  R. 
We  will  show  /  is  continuous  if  and  only  if  its  graph  G  =  {(f,  /(f))  : 
t  E  E}  is  a  compact  subset  of  R2.  Suppose  first  that  /  is  continuous. 
The  proof  of  Proposition  21.2  shows  y(s)  =  (s,  f(s ))  is  a  continuous 
function  on  E,  so  its  image  7 (E)  =  G  is  compact  by  Theorem  21.4(i). 

Now  assume  G  is  compact,  but  /  is  not  continuous  at  to  in  E. 
Then  there  exists  an  e  >  0  and  a  sequence  (tn)  in  E  such  that 

lim tn  =  t0  and  \  f  (tn)  -  f  (t0)\  >  e  for  all  n.  (1) 

n 

Since  G  is  a  bounded  set,  the  Bolzano- Weierstrass  Theorem  13.5 
shows  (tn,  f(tn ))  has  a  convergent  subsequence  (fnfc,  f(tnk)).  Its  limit 
is  in  G,  because  G  is  closed  in  R2  by  the  Heine-Borel  Theorem  13.12. 
Thus  there  exists  t  in  E  so  that  lim k(tnk,  f(tnk))  =  (t, /(f)).  Since 
limn  tn  =  t0,  we  have  t  =  to,  and  therefore  limfe(fnfc,  /(fnJ)  = 
{to,f(t0)).  In  particular,  lim kf(tnk)  =  /(to),  which  contradicts  the 
inequality  in  (1). 

Mark  Lynch  [44]  uses  the  fact  above  to  give  a  very  interesting 
construction  of  a  continuous  nowhere-differentiable  function  on  a 
closed  interval  [0, 1];  see  his  construction  on  page  361.  □ 

21.6  Remark. 

The  remainder  of  this  section  will  be  devoted  to  the  Baire  Cate¬ 
gory  Theorem  and  some  interesting  consequences.  We  will  need  some 
metric-space  terminology,  some  of  it  from  §13.  Let  (S',  d)  be  a  metric 
space.  For  a  subset  E  of  S,  its  complement  is  S\E  =  {s  €  S  :  s  ^  E}. 
A  point  s  is  in  the  interior  of  a  set  E,  or  interior  to  E,  if  s  E  V  CE 
for  some  open  subset  V  of  S.  A  subset  E  of  S  is  closed  if  S  \  E  is 
open.  A  point  s  is  in  the  closure  of  a  set  E  if  every  open  set  con¬ 
taining  s  also  contains  an  element  of  E.  We  write  E~  for  the  set  of 
points  in  the  closure  of  E. 

A  subset  D  of  S  is  dense  in  S  if  every  nonempty  open  set  U 
intersects  D,  i.e.,  DCiU  7^  0.  For  example,  Q  is  dense  in  R,  since  every 
nonempty  open  interval  in  R  contains  rationals;  see  4.7  on  page  25. 
Finally,  a  totally  new  definition:  a  subset  E  of  S  is  nowhere  dense  in 
S  if  its  closure  E~  has  empty  interior.  Obviously  E  is  nowhere  dense 
if  and  only  if  E~  is  nowhere  dense.  Also,  E  is  nowhere  dense  in  S  if 
and  only  if  S  \  E~  is  dense  in  S. 
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Each  part  of  the  next  theorem  is  a  variant  of  what  is  called  the 
Baire  Category  Theorem.  After  that  theorem,  we  will  give  the  ulti¬ 
mate  version  of  this  theorem  and  explain  the  terminology  “category.” 
Just  as  in  Example  4  on  page  88,  open  balls  Br{x o)  =  (x  E  S  : 
d(x,x o)  <  r}  in  S  are  open  sets,  and  closed  balls  Cr(x o)  =  {x  6  S  : 
d(x,x o)  <  r}  are  closed  sets.  Note  Cs{xq)  C  Br(x o)  for  s  <r. 

21.7  Theorem. 

Tef  (S',  d)  6e  a  complete  metric  space.  Then 

(a)  If  (Un)  is  a  sequence  of  dense  open  subsets  of  S,  then  the 
intersection  X  =  nff=1Un  is  dense  in  S. 

(b)  If  (Fn)  is  a  sequence  of  closed  subsets  of  S  and  if  the  union 
F  =  U^=1Fn  contains  a  nonempty  open  set,  then  so  does  at 
least  one  of  the  sets  Fn. 

(c)  The  union  of  a  sequence  of  nowhere  dense  subsets  of  S  has  dense 
complement. 

(d)  The  space  S  is  not  a  union  of  a  sequence  of  nowhere  dense 
subsets  of  S. 

Proof 

All  the  hard  work  will  be  in  proving:  Part  (a).  Consider  a  nonempty 
open  subset  V  of  S;  we  need  to  show  Ink  ^  0.  Since  JJ\  is  open 
and  dense  and  V  is  open,  U\  n  V  is  open  and  nonempty.  So  there 
exists  x\  E  U\  n  V  and  n  <  1  so  that  Cri(x i)  C  U\  n  V.  Since  U2  is 
open  and  dense  and  Bri  (x\  )  is  open,  there  exists  X2  E  Bri(x  1)  D  U2 
and  T2  <  1  so  that  Cr2(x 2)  C  Bri(x  1)  n  U2-  Continuing,  we  obtain 
sequences  (xk)  in  S  and  positive  numbers  (r^)  so  that 

xk+1  €  Brk{xk),  rk  <  — and  Crk+1(xk+1 )  C  Brk(xk )  n  Uk+1. 

Note  d(xk,xk+i)  <  rk  for  all  k,  so  for  m  <  n  we  have 

n—  1  n—  1  j  00  ^  ^ 

d(xm,xn)  <  Y,  d(xk,xk+ 1)  <  <  XI  2^  =  ^1=2- 

k=m  k=m  k=m 

Thus  the  sequence  (xk)  is  a  Cauchy  sequence  in  S.  Since  S  is 
complete,  we  have  lim^  xk  =  x  for  some  x  E  S.  Since  we  have 

Xk  G  Crk(xk)  c  Crn(xn)  for  k>  n, 
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and  since  Crn(xn)  is  closed,  x  also  belongs  to  Cr,n .  This  is  true  for 
all  n,  so 


®  6  n  Crn(xn)  c  p|  un = x. 

71=1  71=1 

Since  we  also  have  x  E  Cri(x i)  C  V,  we  conclude  x  E  X  D  V,  as 
desired. 

Part  (b).  Suppose  U^L1Fn  has  nonempty  interior.  Then  S  \ 
U™=lFn  =  n^B=1  (S'  \  Fn)  is  not  dense  in  S.  Since  the  sets  S  \  Fn 
are  open,  part  (a)  shows  that  at  least  one  of  them,  say  S  \  Fm,  is 
also  not  dense  in  S.  Thus  its  complement  Fm  contains  a  nonempty 
open  set. 

Part  (c).  Let  A  =  U %LiAn  be  the  union  of  a  sequence  of  nowhere 
dense  sets  An.  We  need  to  show  the  complement  of  A,  S  \  A,  is 
dense  in  S.  If  we  replace  each  An  by  its  closure,  they  will  still  be 
nowhere  dense  and  S  \  A  only  gets  smaller.  In  other  words,  we  may 
assume  each  An  is  closed  and  nowhere  dense.  Part  (b)  implies  that 
A  contains  no  nonempty  open  set.  Thus  every  nonempty  open  set 
intersects  S\A,  and  S  \  A  is  dense  in  S. 

Part  (d).  This  is  obvious  from  part  (c),  since  the  complement  of 
S  is  the  empty  set  0.  ■ 


Theorem  21.7  tells  us  in  different  ways  that  the  union  of  a  se¬ 
quence  of  nowhere  dense  subsets  of  a  complete  metric  space  is  small 
relative  to  the  size  of  S.  For  this  reason,  it  is  common  to  divide  the 
subsets  of  S  into  two  categories.  Category  1  consists  of  sets  that  are 
unions  of  sequences  of  nowhere  dense  subsets  of  S,  and  Category  2 
consists  of  the  other  subsets  of  S.  Here  is  part  (d)  of  Theorem  21.7 
restated  using  this  language. 

21.8  Baire  Category  Theorem. 

A  complete  metric  space  ( S ,  d)  is  of  the  second  category  in  itself. 

The  expression  “in  itself”  here  deserves  a  comment.  Many  topo¬ 
logical  properties  about  sets  ECS  depend  on  the  set  S.  For 
example,  the  set  (0, 1]  is  not  closed  in  S  =  K,  but  it  is  closed  in 
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S  =  (0,  oo)  viewed  as  a  metric  space.  Category  is  another  prop¬ 
erty  that  depends  on  S,  so  “in  itself”  in  Theorem  21.8  stresses  the 
reference  to  the  complete  metric  space  S'.1 

21.9  Corollary. 

Each  of  the  spaces  Rfc  is  of  second  category  in  itself. 

Example  7 

Any  set  that  can  be  listed  as  a  sequence  is  said  to  be  “countable.” 
Other  sets  are  “uncountable.” 

(a)  Countable  unions  of  sets  of  first  category  are  sets  of  first  cate¬ 
gory.  For  example,  countable  subsets  of  R,  and  more  generally 
of  Rfc,  are  of  first  category,  since  single  points  {x}  in  these 
spaces  are  nowhere  dense.  This  and  Corollary  21.9  give  another 
(rather  heavy-handed)  proof  that  R  is  uncountable;  compare 
Exercise  16.8. 

(b)  Example  3  on  page  70  shows  the  set  Q  of  rationals  is  countable. 
Thus  Q  is  of  first  category  in  R,  and  the  set  of  irrationals  is  of 
second  category  in  R. 

(c)  Each  straight  line  in  the  plane  R2  is  of  first  category  in  R2,  so 
a  countable  union  of  straight  lines  is  of  first  category  in  R2.  □ 

21.10  Discussion. 

A  closed  set  E  in  a  metric  space  is  said  to  be  perfect  if  every  point 
x  in  E  is  the  limit  of  a  sequence  of  points  in  E  \  {x};  compare 
Proposition  13.9(b).  This  proposition  also  shows  closed  subsets  of 
complete  metric  spaces  are  themselves  complete  metric  spaces.  In 
a  perfect  subset  £  of  a  complete  metric  space,  single  points  are 
nowhere  dense  in  E,  so  countable  subsets  of  E  are  of  first  cate¬ 
gory.  Therefore,  nonempty  perfect  subsets  of  complete  metric  spaces 
are  uncountable.  The  Cantor  set  (in  Example  5  on  page  89)  is  an 
interesting  compact  perfect  set.  □ 

Recall  Exercise  17.14,  where  a  function  on  R  is  described  that  is 
continuous  at  each  irrational  and  discontinuous  at  each  rational.  In 


1One  of  the  fine  properties  of  compactness  is:  If  a  set  is  compact  in  some  set, 

then  it  is  compact  in  all  sets. 


§21.  *  More  on  Metric  Spaces:  Continuity 


the  next  example,  we  will  show  there  are  no  functions  on  R  that  are 
continuous  at  only  the  rationals. 

Example  8 

(a)  Consider  any  function  /  on  R.  For  each  x  in  R,  let 

=  inf  sup{|/(y)  —  f(z)\  :y,z  e  [x  -  <5,  x  +  <5)}. 

<5>0 

The  function  ujf  is  the  “oscillation  function”  of  /.  The  function 
/  is  continuous  at  x  if  and  only  if  ujf(x)  =  0;  see  Exercise  21.13. 

We  show  each  set  {x  6  R  :  uif(x)  <  e}  is  open  in  R;  e  >  0. 
Suppose  cof(x o)  <  e;  we  need  to  show  this  inequality  holds  in 
an  interval  containing  xq.  By  the  definition,  there  exists  5  >  0 
such  that 

sup{|/(y)  -  f(z) |  :  y,z  G  (x0  -  S,x0  +  <5)}  <  e. 

For  x  G  (xq  —  f ,  xo  + 1)  we  have  (x—  f ,  x+  |)  C  (xq  —  8,  xq  +  <5), 
and  therefore 

uf(x)  <  sup  ||/(y)  -  f(z) |  :  y,z  € 

<  sup{|/(y)  -  f(z) |  :  y,z  €  (x0  -  5,x0  +  5)}  <  e. 

(b)  There  is  no  function  /  on  R  that  is  continuous  only  on  the  set 
Q  of  rational  numbers.  Otherwise,  by  part  (a)  the  equality 

°o  ,  1 

Q  =  {x  G  R  :  ojf{x)  =  0}=P|<xGR:  uif(x)  <  — 

would  express  Q  as  the  intersection  of  a  sequence  of  open 
subsets  of  R,  contrary  to  Exercise  21.11.  □ 

21.11  Theorem. 

No  nondegenerate  interval  I  in  R  can  be  written  as  the  disjoint 
union  of  two  or  more  nondegenerate  closed  intervals.  (An  interval 
is  “nondegenerate”  if  it  has  more  than  one  point.) 

Proof 

We  prove  the  theorem  for  I  =  [a,b],  a  <  b,  and  leave  the  other  cases 
to  Exercise  21.14.  Assume  I  is  the  disjoint  union  of  two  or  more 
nondegenerate  closed  intervals.  It  is  clear  there  are  infinitely  many 
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such  intervals,  because  otherwise  they  could  be  listed  in  order,  and 
there  would  be  points  in  I  between  the  first  and  second  interval. 
It  is  also  clear  that  the  family  can  be  listed  as  a  sequence  (i.e.,  is 
countable),  since  there  is  a  one-to-one  function  from  the  collection 
of  disjoint  intervals  into  Q. 

So  we  assume  I  =  U^L-Ja^,  6/;].  By  Discussion  13.7(iii)  on  page  87, 
the  union  U^=1(afc,  bk)  is  open,  so  that  K  =  J\U^=1(afc,  6/,;)  is  closed. 
Then  K  is  the  set  of  endpoints  of  the  removed  intervals,  so  K  is 
nonempty  and  countable.  We  will  show  K  is  perfect,  and  this  will 
be  a  contradiction  by  Discussion  21.10.  Consider  x  in  K ;  we  may 
assume  x  ^  b.  Consider  an  interval  (x,  x  +  h)  where  h  >  0.  Some 
closed  interval  [am,bm\  must  intersect  (x,x  +  h),  and  [am,bm\  cannot 
contain  x  in  K.  Thus  x  <  am  <  x  +  h.  Since  am  is  in  K,  the  interval 
(x,  x  +  h)  intersects  K,  and  since  h  >  0  is  arbitrary,  x  is  a  limit  of 
points  in  K\{x}.  This  shows  K  is  perfect,  completing  the  proof.  ■ 

A  close  examination  of  Example  8(b)  and  Theorem  21.11  shows 
they  both  depend  on  the  Baire  Category  Theorem  21.8.  Other  ap¬ 
plications  of  this  theorem  appear  in  Theorem  38.3  and  twice  in 
Theorem  38.5. 


Exercises 

21.1  Show  that  if  the  functions  /i,  /2,  •  ■  • ,  fk  in  Proposition  21.2  are 
uniformly  continuous,  then  so  is  7. 

21.2  Consider  /:  S  — >  S*  where  (S,d)  and  ( S*,d *)  are  metric  spaces. 
Show  that  /  is  continuous  at  So  £  S  if  and  only  if 

for  every  open  set  U  in  S*  containing  /(so),  there  is 
an  open  set  V  in  S  containing  s0  such  that  f(V )  C  U. 

21.3  Let  (S,  d)  be  a  metric  space  and  choose  so  £  S.  Show  f(s)  =  d(s,  sq) 
defines  a  uniformly  continuous  real-valued  function  /  on  S. 

21.4  Consider  /:  S  — >  M  where  (S,  d )  is  a  metric  space.  Show  the  following 
are  equivalent: 

(i)  /  is  continuous; 

(ii)  /-1((a,  b ))  is  open  in  S  for  all  a  <  6; 

(iii)  /-1((a,  b))  is  open  in  S  for  all  rational  a  <  b. 


Exercises  \~f~( 


21.5  Let  £  be  a  noncompact  subset  of  Rfc. 

(a)  Show  there  is  an  unbounded  continuous  real-valued  function 
on  E.  Hint :  Either  E  is  unbounded  or  else  its  closure  E~ 
contains  Xq  £  E.  In  the  latter  case,  use  ^  where  g(x)  = 
d(x,x  o). 

(b)  Show  there  is  a  bounded  continuous  real-valued  function  on  E 
that  does  not  assume  its  maximum  on  E. 

21.6  For  metric  spaces  (Si,  di),  (S2,d2),  (S3,  cfe),  prove  that  if  /:  Si  — ►  S2 
and  g:  S2  — >•  S3  are  continuous,  then  go  f  is  continuous  from  Si  into 
S3.  Hint :  It  is  somewhat  easier  to  use  Theorem  21.3  than  to  use  the 
definition. 

21.7  (a)  Observe  that  if  E  C  S  where  (S,d)  is  a  metric  space,  then 

( E ,  d )  is  also  a  metric  space.  In  particular,  if  £  C  R,  then 
d(a,  b)  =  \a—  b\  for  a,b  £  E  defines  a  metric  on  E. 

(b)  For  7:  [a,  b]  — ►  Rfc,  give  the  definition  of  continuity  of  7. 

21.8  Let  (S,d)  and  ( S*,d *)  be  metric  spaces.  Show  that  if  f:S  S*  is 
uniformly  continuous,  and  if  (sn)  is  a  Cauchy  sequence  in  S,  then 
( f(sn ))  is  a  Cauchy  sequence  in  S*. 

21.9  We  say  a  function  /  maps  a  set  E  onto  a  set  F  provided  f(E)  =  F. 

(a)  Show  there  is  a  continuous  function  mapping  the  unit  square 

{(xi,x2)  £l2:0<ii<l,0<i2<l} 

onto  [0,1]. 

(b)  Do  you  think  there  is  a  continuous  function  mapping  [0, 1]  onto 
the  unit  square? 

21.10  Show  there  exist  continuous  functions 

(a)  Mapping  (0,1)  onto  [0,1], 

(b)  Mapping  (0, 1)  onto  R, 

(c)  Mapping  [0, 1]  U  [2,  3]  onto  [0, 1]. 

(d)  Explain  why  there  are  no  continuous  functions  mapping  [0, 1] 
onto  (0, 1)  or  R. 

21.11  Show  the  set  Q  of  rational  numbers  is  not  the  intersection  of  a 
sequence  of  open  sets,  so  that  the  set  R  \  Q  of  irrational  numbers  is 
not  the  union  of  a  sequence  of  closed  subsets  of  R. 
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21.12  Give  an  example  of  an  infinite  disjoint  sequence  of  subsets  of  M,  each 
of  which  is  of  second  category  in  R. 

21.13  Let  w/  be  the  oscillation  function  in  Example  8(a).  Show  that  /  is 
continuous  at  x  in  M  if  and  only  if  tOf{x)  =  0. 

21.14  Complete  the  proof  of  Theorem  21.11.  Hint :  Assume  a  nondegener¬ 
ate  interval  I  in  M  is  the  union  of  two  or  more  disjoint  nondegenerate 
closed  intervals.  Select  points  x  <  y  in  /,  so  that  they  are  interior  to 
two  distinct  such  subintervals.  Show  [x,  y }  is  also  the  union  of  two  or 
more  disjoint  nondegenerate  closed  intervals,  contradicting  the  case 
covered  in  the  proof  of  Theorem  21.11. 


§22  *  More  on  Metric  Spaces: 

Connectedness 

Consider  a  subset  E  of  R  that  is  not  an  interval.  As  noted  in  the 
proof  of  Corollary  18.3,  the  property 

Vi,V2^E  and  yi  <  y  <  y2  imply  y  e  E 

must  fail.  So  there  exist  y\ ,  y2 ,  y  in  M  such  that 

yi<y<V2,  yi,y2€E,  y  E.  (*) 

The  set  E  is  not  “connected”  because  y  separates  E  into  two  pieces. 
Put  another  way,  if  we  set  U\  =  (— oo ,y)  and  U2  =  (y,  oo),  then  we 
obtain  open  sets  so  that  EC\U\  and  EDU2  are  disjoint  nonempty  sets 
who  union  is  E.  The  last  observation  can  be  promoted  to  a  useful 
general  definition. 

22.1  Definition. 

Let  E  be  a  subset  of  a  metric  space  (5,  d).  The  set  E  is  disconnected 
if  one  of  the  following  two  equivalent  conditions  holds. 

(a)2  There  are  open  subsets  U\  and  U2  of  S  such  that 

(E  n  ih)  n  {E  n  u2)  =  0  and  E  =  (Enu1)u(Enu2),  (1) 

Enu1^0  and  EnU2^0.  (2) 


2  Readers  familiar  with  relative  topologies  will  recognize  this  as  stating  that  E  is 
a  disjoint  union  of  nonempty  relatively-open  subsets  of  E. 
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(b)  There  are  disjoint  nonempty  subsets  A  and  B  of  E  such  that 
E  =  A  U  B  and  neither  set  intersects  the  closure  of  the  other 
set,  i.e., 

A~  HB  =  0  and  A  n  B~  =  0.  (3) 

A  set  E  is  connected  if  it  is  not  disconnected. 

Remark.  We  show  that  conditions  (a)  and  (b)  above  are 
equivalent. 

If  (a)  holds,  set  A  =  E  n  U\  and  B  =  E  fl  C^.  To  check  (b),  we 
need  only  verify  (3).  If,  for  example,  A~  n  B^0,  then  there  exists 
b  E  A~(lB  C  C/2,  so  there  is  r  >  0  so  that  {s  6  S  :  d(s,b )  <  r}  C  U 2. 
Since  b  is  in  A~,  Proposition  13.9(c)  shows  there  is  a  in  A  such  that 
d(a,  b)  <  r.  But  then  a  E  U2  n  E  =  B,  a  contradiction,  since  A  and 
B  are  disjoint.  Thus  (3)  holds,  and  condition  (b)  holds. 

Now  suppose  that  (b)  holds.  Let  U\  =  S  \  B~  and  U2  =  S  \  A~ . 
To  verify  (a),  it  suffices  to  show  E  n  U\  =  A  and  E  n  U2  =  B. 
For  example,  x  E  E  fl  JJ\  implies  x  E  S  \  B  implies  x  ^  B.  Since 
x  E  A  U  B,  we  conclude  x  E  A.  Finally,  if  x  E  A,  then  x  £  B~ 
by  (3),  so  x  E  S  \  B~  =  U\.  Therefore  x  is  in  E  n  U\.  We’ve  shown 
E  n  C/i  =  A. 


Example  1 

As  noted  before  the  definition,  sets  in  R  that  are  not  intervals  are 
disconnected.  Conversely,  intervals  in  R  are  connected.  To  prove  this 
from  the  definition,  we  will  assume  the  contrary  and  obtain  a  con¬ 
tradiction.  So  we  assume  there  is  an  interval  I  and  open  sets  U\  and 
U2  disconnecting  I  as  in  Definition  22.1(a).  Select  a  E  /  fl  U\  and 
b  E  I  n  C/2.  We  may  suppose  a  <  b.  Now  the  interval  [a,b\  satisfies 
the  same  conditions  in  Definition  22.1(a)  as  I.  So  we  may  assume 
I  =  [a,b],  aEC/i  and  b  E  C/2. 

Let  t  =  sup[a,  b)  fl  Ui,  so  that  t  >  a.  Since  (b  —  e,  b\  C  C/2  for  some 
e  >  0,  we  also  have  t  <  b.  If  t  is  in  U\,  then  [t,t  +  e)  C  U\  n  [a,  b] 
for  some  e  >  0,  but  then  t  =  sup[a,  b)  0U\  >  t  +  e.  If  f  E  C/2,  then 
(t  —  e,  t]  C  C/2  fl  [a,  b\,  which  would  imply  t  =  sup[a,  b)  fl  C/ 1  <  t  —  e. 
Each  possibility  leads  to  a  contradiction,  so  [a,  b]  and  the  original 
interval  I  are  connected.  □ 
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22.2  Theorem. 

Consider  metric  spaces  ( S,d ),  ( S*,d *),  and  let  f:S  ->  S*  be  con¬ 
tinuous.  If  E  is  a  connected  subset  of  S,  then  f(E)  is  a  connected 
subset  of  S* . 

Proof 

Assume  f(E)  is  not  connected  in  S*.  Then  there  exist  open  sets  V\ 
and  V2  in  S*  such  that 

(HE)  n  th)  n  (f(E)  n  v2)  =  0,  f(E)  =  (f(E)  n  Pi)  u  (f(E)  n  v2), 
f(E)  nVi/0  and  f(E)  nV2^0. 

Let  Ui  =  /_1(p)  and  U2  =  /_1(V 2).  Then  U\  and  U2  are  open 
sets  in  S  that  separate  E  as  in  Definition  22.1(a).  Thus  E  is  not 
connected,  a  contradiction.  ■ 

The  next  corollary  generalizes  Theorem  18.2  and  its  corollary. 

22.3  Corollary. 

Let  f  be  a  continuous  real-valued  function  on  a  metric  space  ( S,d ). 
If  E  is  a  connected  subset  of  S,  then  f(E)  is  an  interval  in  M.  In 
particular,  f  has  the  intermediate  value  property. 

Example  2 

Curves  are  connected.  That  is,  if  7  is  a  path  in  as  described  in 
Example  3  of  §21,  page  165  and  I  is  a  subinterval  of  M,  then  the 
image  7  (/)  is  connected  in  Mfc.  □ 

22.4  Definition. 

A  subset  E  of  a  metric  space  (5,  d)  is  said  to  be  path- connected  if, 
for  each  pair  s,  t  of  points  in  E,  there  exists  a  continuous  function 
7:  [a,  b\  — >  E  such  that  7(a)  =  s  and  7 (b)  =  t.  We  call  7  a  path. 

22.5  Theorem. 

If  E  in  ( S,d )  is  path- connected,  then  E  is  connected.  [ The  failure  of 
the  converse  is  illustrated  in  Exercise  22. 4-] 

Proof 

Assume  E  is  disconnected  by  open  sets  U\  and  U2: 

(EnUi)n  (Enu2)  =  0  and  E  =  (E  C  U\)  U  (£n  U2),  (1) 
E  n  Ui  ^  0  and  E  n  U2  ^  0.  (2) 
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FIGURE  22.1 


Select  s  £  E  n  U\  and  t  E  E  n  Ui-  Let  7:  [a,  b]  — >  E  be  a  path  where 
7(a)  =  s  and  7(6)  =  t.  Let  F  =  7([a,  &]).  Then  (1)  and  (2)  hold 
with  F  in  place  of  E.  Thus  F  is  disconnected,  but  F  is  connected  by 
Theorem  22.2.  ■ 


Figure  22.1  gives  a  path-connected  set  and  a  disconnected  set 
in  M2. 

Example  3 

Many  familiar  sets  in  such  as  the  open  ball  { x  :  d(x,  0)  <  r},  the 
closed  ball  {x  :  d(x,  0)  <  r}  and  the  fc-dimensional  cube 

{x  :  max{|xj|  :  j  =  1,  2 ,...,&}<  1} 


182  **•  Continuity 


are  convex.  A  subset  E  of  is  convex  if 

x,y  £  E  and  0  <  t  <  1  imply  tx  +  (1  —  t)y  E  E, 

i.e. ,  whenever  E  contains  two  points  it  contains  the  line  segment 

connecting  them.  See  Fig.  22.1.  Convex  sets  E  in  are  always 
path-connected.  This  is  because  y(t)  =  tx  +  (1  —  t)y  defines  a  path 
7:  [0, 1]  — >  E  such  that  7(0)  =  y  and  7(1)  =  x.  For  more  details,  see 
any  book  on  several  variable  calculus.  □ 

Example  4 

This  example  is  adapted  from  [15].  Suppose  I  is  an  interval  in  M 

and  /  :  /  -i  1  is  a  function  with  graph  G  =  {(x,f(x))  :  x  E  /}. 

Then  /  is  continuous  if  and  only  if  G  is  path-connected.  Note 
that  “path-connected”  here  cannot  be  changed  to  “connected;”  see 
Exercise  22.13. 

If  /  is  continuous,  then  for  each  (a,  /(a))  and  (6,  f(b))  in  G,  7 (t)  = 
( t ,  f(t))  is  a  path  connecting  these  points.  Note  that  7  is  continuous 
by  Proposition  21.2. 

For  the  converse,  assume  G  is  path-connected.  Consider  a,  b  in  / 
where  a  <  b.  Since  G  is  path-connected,  there  is  a  continuous  func¬ 
tion  7  :  [0, 1]  -»  G  satisfying  7(0)  =  (a,  /(a))  and  7(1)  =  (6,  /(&)).  By 
Proposition  21.2,  we  can  write  y(t)  =  (x(t),y(t))  where  x  and  y  are 
continuous  real- valued  functions  on  [0. 1].  Of  course,  y(t)  =  f(x(t )) 
for  all  t.  First,  we  claim 

:  z  E  [a,b\}  C  7([0,1]).  (1) 

Since  x(t)  is  continuous  on  [0,1],  x(0)  =  a  and  x(l)  =  b,  the 
Intermediate  Value  Theorem  18.2  for  continuous  functions  shows 
that  if  z  is  in  (a,  6),  then  x(t)  =  z  for  some  t  E  (0,1).  Thus 
( z,f(z ))  =  (x(t),  f(x(t)))  =  7 (t).  Since  the  cases  z  =  a  and  z  =  b 
are  trivial,  this  implies  (1). 

Next  we  show  /  satisfies  IVP,  the  intermediate  value  property: 
(IVP)  If  a,  6  E  I,  a  <  b  and  c  is  between  /(a)  and  /(&),  then 
f(x)  =  c  for  some  x  E  [a,  b\. 

Let  a  =  sup{f  E  [0, 1]  :  x{t)  <  a}  and  /3  =  infjt  E  [0, 1]  : 
x(t)  >  b}.  Thus  0  <  a  <  /3  <  1.  Since  x(t)  is  continuous,  we  see 
that  x([a,{3})  =  [a,  b\.  Now  we  apply  the  Intermediate  Value  Theo¬ 
rem  again,  this  time  to  f(x(t))  on  [a,/?].  Since  f(x(a ))  =  /(a)  and 
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f(x(/3))  =  f(b),  we  have  f(x(t))  =  c  for  some  t  in  (a,/3).  For  this  t 
we  have  x(t)  G  [a,  b\,  so  we  have  verified  IVP. 

Now  assume  /  is  not  continuous  on  I.  Then  there  exists  xq  G  I, 
e  >  0,  and  a  sequence  (xn)  in  I  that  converges  to  xq  satisfying 
I f{xn)  -  fix 0)|  >  e  for  all  re.  Then  f(xn)  >  f(x0)  +  e  >  f(x0)  for 
infinitely  many  n,  or  else  f{xn)  <  f(x o)  —  e  <  f(x o)  for  infinitely 
many  re.  Passing  to  a  subsequence,  we  may  assume  f(xn)  >  f(x o)  + 
e  >  f(x o)  for  all  re,  say.  By  the  IVP,  for  each  re  there  is  yn  between 
xn  and  xq  so  that  f(yn)  =  f(x0)  +  e.  Then  (yn,  f(yn ))  is  a  sequence 
in  G  satisfying 

lim yn  =  x0  and  lim (yn,  f(yn ))  =  (x0,  f(x0)  +  e).  (2) 

n 

Moreover,  there  exist  a  <  b  in  I  such  that  xq  and  all  yn  belong  to 
[a,  b].  We  apply  (1)  to  this  a  and  b  and  7  described  there.  So,  for  each 
re  G  N  there  exists  tn  G  [0, 1]  so  that  7(fn)  =  ( yn ,  f{Vn))-  Passing  to 
a  subsequence  {tnk)k eN  of  (tn),  we  may  assume  that  lim*.  tnk  =  to  for 
some  to  in  [0, 1].  Since  7  is  continuous,  we  conclude  from  (2)  that 

j(t0)  =  lim 7 (tnh)  =  lim (ynk,f(ynk))  =  (x0,  f(x0)  +  e). 

k  k 

Since  this  limit  is  not  in  G,  and  7([0, 1])  C  G,  we  have  a  contradiction 
and  /  is  continuous  on  I.  □ 

We  end  this  section  with  a  discussion  of  some  very  different  metric 
spaces.  The  points  in  these  spaces  are  actually  functions  themselves. 

22.6  Definition. 

Let  S'  be  a  subset  of  M.  Let  C(S )  be  the  set  of  all  bounded  continuous 
real- valued  functions  on  S  and,  for  f,g€.  C(S),  let 

d(f,g)  =  sup{|/(x)  -  g{x)\  :  x  G  S'}. 

With  this  definition,  C(S)  becomes  a  metric  space  [Exercise  22.6]. 
In  this  metric  space,  a  sequence  (fn)  converges  to  a  point  [function!] 
/  provided  lim^oo  d(fn ,  /)  =  0,  that  is 

lim  sup{|/n(x)  -  f(x)\  :  x  G  5}  =  0.  (*) 

n— 7-oo 

Put  another  way,  for  each  e  >  0  there  exists  a  number  N  such  that 
|  fn(x)  —  f(x)  |  <  e  for  all  16S  and  re  >  N. 
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We  will  study  this  important  concept  in  the  next  chapter,  but 
without  using  metric  space  terminology.  See  Definition  24.2  and 
Remark  24.4  where  (*)  is  called  uniform  convergence. 

A  sequence  (fn)  in  C(S )  is  a  Cauchy  sequence  with  respect  to 
the  metric  d  exactly  when  it  is  uniformly  Cauchy  as  defined  in  Defi¬ 
nition  25.3.  In  our  metric  space  terminology,  Theorems  25.4  and  24.3 
tell  us  that  C(S)  is  a  complete  metric  space. 

Exercises 

22.1  Show  there  do  not  exist  continuous  functions 

(a)  Mapping  [0, 1]  onto  [0, 1]  U  [2,  3], 

(b)  Mapping  (0, 1)  onto  Q. 

22.2  Show  {(x\,X2)  €  R2  :  x\  +  x%  =  1}  is  a  connected  subset  of  R2. 

22.3  Prove  that  if  I?  is  a  connected  subset  of  a  metric  space  (S,  d),  then 
its  closure  E~  is  also  connected. 

22.4  Consider  the  following  subset  of  R2: 


E  is  simply  the  graph  of  g(x)  =  sin  f  along  the  interval  (0, 1]. 


(a)  Determine  its  closure  E  .  See  Fig.  19.4. 

(b)  Show  E  is  connected. 

(c)  Show  E~  is  not  path-connected. 

22.5  Let  E  and  F  be  connected  sets  in  some  metric  space. 

(a)  Prove  that  if  E  D  F  0,  then  E  U  F  is  connected. 

(b)  Give  an  example  to  show  E  D  F  need  not  be  connected. 
Incidentally,  the  empty  set  is  connected. 

22.6  (a)  Show  C(S)  given  in  Definition  22.6  is  a  metric  space. 

(b)  Why  did  we  require  the  functions  in  C(S)  to  be  bounded  when 
no  such  requirement  appears  in  Definition  24.2? 


22.7  Explain  why  the  metric  space  B  in  Exercise  13.3  can  be  regarded 
as  C(N). 
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22.8  Consider  C(S)  for  a  subset  S  of  R.  For  a  fixed  so  dr  S,  define  F(f)  = 
/(so).  Show  F  is  a  uniformly  continuous  real- valued  function  on  the 
metric  space  C(S). 

22.9  Consider  f,g  £  C(S)  where  5CR.  Let  F(t)  =  tf  +  (1  —  t)g.  Show 
F  is  a  uniformly  continuous  function  from  R  into  C(S). 

22.10  Let  /  be  a  (fixed)  uniformly  continuous  function  in  C'(R).  For  each 
x  £  R,  let  fx  be  the  function  defined  by  fx{y)  =  f{x  +  y)  for  y  £  R. 
Let  F(x)  =  fx',  show  F  is  uniformly  continuous  from  R  into  C(R). 

22.11  Consider  C(S)  where  SCR,  and  let  £  consist  of  all  /  in  C(S)  such 
that  sup{|/(x)|  :  x  £  5}  <  1. 

(a)  Show  £  is  closed  in  (7(5). 

(b)  Show  C(S)  is  connected. 

(c)  Show  £  is  connected. 

22.12  Consider  a  subset  £  of  (7(5),  S  C  R.  For  this  exercise,  we  say  a 
function  /o  in  £  is  interior  to  £  if  there  exists  a  finite  subset  F  of  S 
and  an  e  >  0  such  that 

{/  £  C(S)  :  \f(x)  -  f0(x)\  <  e  for  x£F}C£. 

The  set  £  is  open  if  every  function  in  £  is  interior  to  £ . 

(a)  Reread  Discussion  13.7. 

(b)  Show  the  family  of  open  sets  defined  above  forms  a  topology  for 
C(S).  Remarks.  This  topology  is  different  from  the  one  given 
by  the  metric  in  Definition  22.6.  In  fact,  this  topology  does 
not  come  from  any  metric  at  all!  It  is  called  the  topology  of 
pointwise  convergence  and  can  be  used  to  study  the  convergence 
in  Definition  24.1  just  as  the  metric  in  Definition  22.6  can  be 
used  to  study  the  convergence  in  Definition  24.2. 

22.13  Let  /  be  the  function  defined  on  [0,  oo)  by  f(x)  =  (x,  sin(l/x))  for 
x  >  0  and  /( 0)  =  0.  Show  that  the  graph  of  /  is  connected  but  not 
path-connected;  compare  Exercise  22.4.  Is  /  continuous  on  [0,  oo)? 

22.14  Consider  a  bounded  sequence  (s„)  in  R  and  its  set  S  of  subsequential 
limits  as  in  Theorem  11.8.  Show  that  if  limrl(sJi+i— sn)  =  0,  then  S  is 
a  connected  interval  in  R.  This  is  from  [11].  Hint :  Consider  a  <  c  <  b 
where  a  and  b  are  in  S,  and  show  c  is  in  S.  Use  Theorem  11.2. 


Sequences  and 
Series  of 
Functions 


CHAPTER 


In  this  chapter  we  develop  some  of  the  basic  properties  of  power  se¬ 
ries.  In  doing  so,  we  will  introduce  uniform  convergence  and  illustrate 
its  importance.  In  §26  we  prove  power  series  can  be  differentiated  and 
integrated  term-by-term. 


§23  Power  Series 

Given  a  sequence  (an)“=  0  °f  real  numbers,  the  series  o  anXn  is 
called  a  power  series.  Observe  the  variable  x.  Thus  the  power  series 
is  a  function  of  x  provided  it  converges  for  some  or  all  x.  Of  course, 
it  converges  for  x  =  0;  note  the  convention  0°  =  1.  Whether  it 
converges  for  other  values  of  x  depends  on  the  choice  of  coefficients 
( an ).  It  turns  out  that,  given  any  sequence  (an),  one  of  the  following 
holds  for  its  power  series: 

(a)  The  power  series  converges  for  all  i£l; 

(b)  The  power  series  converges  only  for  x  =  0; 

(c)  The  power  series  converges  for  all  x  in  some  bounded  interval 
centered  at  0;  the  interval  may  be  open,  half-open  or  closed. 
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These  remarks  are  consequences  of  the  following  important 
theorem. 

23.1  Theorem. 

For  the  power  series  ^  anxn,  let 

[3  =  limsup  \an\l/n  and  R  =  — . 

[If  (3  =  0  we  set  R  =  +oo,  and  if  f3  =  +oo  we  set  R  =  0.]  Then 

(i)  The  power  series  converges  for  |x|  <  R] 

(ii)  The  power  series  diverges  for  \x\  >  R. 

R  is  called  the  radius  of  convergence  for  the  power  series.  Note 
that  (i)  is  a  vacuous  statement  if  R  =  0  and  that  (ii)  is  a  vacuous 
statement  if  R  =  +oo.  Note  also  that  (a)  above  corresponds  to  the 
case  R  =  +oo,  (b)  above  corresponds  to  the  case  R  =  0,  and  (c) 
above  corresponds  to  the  case  0  <  R  <  +oo. 

Proof  of  Theorem  23.1 

The  proof  follows  quite  easily  from  the  Root  Test  14.9.  Here  are  the 
details.  We  want  to  apply  the  Root  Test  to  the  series  ^  anxn.  So  for 
each  x  E  M,  let  ax  be  the  number  or  symbol  defined  in  14.9  for  the 
series  )T)  anxn.  Since  the  nth  term  of  the  series  is  anxn ,  we  have 

ax  =  limsup  \anxnpn  =  limsup  I^Hanl1^"  =  |a;|  •  limsup  |an|1'/"  =  f)\x\. 

The  third  equality  is  justified  by  Exercise  12.6(a).  Now  we  consider 
cases. 

Case  1.  Suppose  0  <  R  <  +oo.  In  this  case  ax  =  fd\x\  = 

If  \x\  <  R  then  ax  <  1,  so  the  series  converges  by  the  Root  Test. 
Likewise,  if  \x\  >  R ,  then  ax  >  1  and  the  series  diverges. 

Case  2.  Suppose  R  =  +oo.  Then  (3  =  0  and  ax  =  0  no  matter 
what  x  is.  Hence  the  power  series  converges  for  all  x  by  the  Root 
Test. 

Case  3.  Suppose  R  =  0.  Then  (3  =  +oo  and  ax  =  +oo  for  x  ^  0. 
Thus  by  the  Root  Test  the  series  diverges  for  x  ^  0. 
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Recall  that  if  lim  |  a™+1 1  exists,  then  this  limit  equals  (3  of  the  last 
theorem  by  Corollary  12.3.  This  limit  is  often  easier  to  calculate  than 
lim  sup  lanl1/”;  see  the  examples  below. 


Example  1 

Consider  £“  0  ^ xn .  If  an  =  T  then  ^  so  lim  |^tl |  =  0. 

Therefore  /3  =  0,  R  =  +oo  and  this  series  has  radius  of  convergence 
Too.  That  is,  it  converges  for  all  x  in  M.  In  fact,  it  converges  to  ex 
for  all  x,  but  that  is  another  story;  see  Example  1  in  §31,  page  252, 
and  also  §37.  □ 


Example  2 

Consider  J2^=ox11-  Then  /3  =  1  and  R  =  1.  Note  this  series  does 
not  converge  for  s  =  1  or  x  =  -1,  so  the  interval  of  convergence  is 
exactly  (—1,1).  [By  interval  of  convergence  we  mean  the  set  of  x  for 
which  the  power  series  converges.]  The  series  converges  to  by 
formula  (2)  of  Example  1  in  §14,  page  96.  □ 

Example  3 

i 

Consider  n'£n '  Since  Ihn  =  1,  we  again  have  /3  =  1  and 

n 

R  =  1.  This  series  diverges  for  x  =  1  [see  Example  1  of  §15],  but 
it  converges  for  x  =  —1  by  the  Alternating  Series  theorem  15.3  on 
page  108.  Hence  the  interval  of  convergence  is  exactly  [—1, 1).  □ 

Example  4 

Consider  IT2'™-  Once  again  (3  =  1  and  R  =  1.  This  series 

converges  at  both  x  =  1  and  x  =  —1,  so  its  interval  of  convergence 
is  exactly  [—1,1].  □ 

Example  5 

The  series  n-x?l  has  radius  of  convergence  R  =  0  because  we 

have  lim  =  Too.  It  diverges  for  every  x^O.  □ 

Examples  1-5  illustrate  all  the  possibilities  discussed  in  (a)-(c) 
prior  to  Theorem  23.1. 
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Example  6 

Consider  Y^=o  2 ~nx3n .  This  is  deceptive,  and  it  is  tempting  to  cal¬ 
culate  /3  =  limsup(2_n)1/n  =  j  and  conclude  R  =  2.  This  is  wrong 
because  2~n  is  the  coefficient  of  x3n  not  xn ,  and  the  calculation  of 
/?  must  involve  the  coefficients  an  of  xn.  We  need  to  handle  this 
series  more  carefully.  The  series  can  be  written  anXn  where 

a^k  =  and  an  =  0  if  n  is  not  a  multiple  of  3.  We  calculate  ft 
by  using  the  subsequence  of  all  nonzero  terms,  i.e.,  the  subsequence 
given  by  cr(k)  =  3k.  This  yields 

p  =  limsuplonl1/"  =  lim  |a3fc|1/3fc  =  lim  (2"fc)1/3fc  =  2"1/3. 

k — >-oo  k — >-oo 

Therefore  the  radius  of  convergence  is  R  =  ^  =  21/3.  □ 

One  may  consider  more  general  power  series  of  the  form 

CO 

(x-xo)n,  (*) 

n= 0 

where  xq  is  a  fixed  real  number,  but  they  reduce  to  series  of  the 
form  XXq  anyn  by  the  change  of  variable  y  =  x  —  x o-  The  interval 
of  convergence  for  the  series  (*)  will  be  an  interval  centered  at  xq. 


Example  7 

Consider  the  series 


OO 


E 

71=1 


(-l)n+1 


l)n. 


(1) 


The  radius  of  convergence  for  the  series  X^i  — Vn  is  R  =  1,  so 
the  interval  of  convergence  for  the  series  (1)  is  the  interval  (0,  2)  plus 
perhaps  an  endpoint  or  two.  Direct  substitution  shows  the  series  (1) 
converges  at  x  =  2  [it’s  an  alternating  series]  and  diverges  to  — oo  at 
x  =  0.  So  the  exact  interval  of  convergence  is  (0,  2],  It  turns  out  that 
the  series  (1)  represents  the  function  loge  x  on  (0,  2],  See  Examples  1 
and  2  in  §26.  □ 
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FIGURE  23.1 


On  of  our  major  goals  is  to  understand  the  function  given  by  a 
power  series 

oo 

f(x )  =  akXk  for  |s|  <  R. 

k= 0 

We  are  interested  in  questions  like:  Is  /  continuous?  Is  /  differen¬ 
tiable?  If  so,  can  one  differentiate  /  term-by-term: 

OO 

f'{x)  =  ^2,kakxk~l  ? 
k= 1 

Can  one  integrate  /  term-by-term? 

Returning  to  the  question  of  continuity,  what  reason  is  there  to 
believe  /  is  continuous?  Its  partial  sums  fn  =  Yl'k= o  akxk  are  contin¬ 
uous,  since  they  are  polynomials.  Moreover,  we  have  lim^^oo  fn(x)  = 
f(x)  for  |x|  <  R.  Therefore  /  would  be  continuous  if  a  result  like 
the  following  were  true:  If  (fn)  is  a  sequence  of  continuous  functions 
on  (a,  b)  and  if  limn_>,00  fn (x)  =  f(x)  for  all  x  E  (a,  6),  then  /  is 
continuous  on  (a,  b).  However,  this  fine  sounding  result  is  false! 

Example  8 

Let  fn(x )  =  (1  —  \x\)n  for  x  E  (—1,1);  see  Fig.  23.1.  Let  f(x)  =  0 
for  x  ^  0  and  let  /( 0)  =  1.  Then  we  have  lim^^oo  fn(x)  =  f(x) 
for  all  x  E  (—1,1),  since  limn_>,00  an  =  0  if  |a|  <  1.  Each  fn  is  a 
continuous  function,  but  the  limit  function  /  is  clearly  discontinuous 
at  x  =  0.  □ 

This  example,  as  well  as  Exercises  23.7-23.9,  may  be  discourag¬ 
ing,  but  it  turns  out  that  power  series  do  converge  to  continuous 
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functions.  This  is  because 

n  oo 

lim  V  aj~xk  converges  uniformly  to  akXk 

n—¥  00  ' 

fc=0  fc=0 

on  sets  [— R\,Ri]  such  that  R\  <  R.  The  definition  of  uniform  con¬ 
vergence  is  given  in  the  next  section,  and  the  next  two  sections  will 
be  devoted  to  this  important  notion.  We  return  to  power  series  in 
§26,  and  again  in  §31. 


Exercises 


23.1  For  each  of  the  following  power  series,  find  the  radius  of  convergence 
and  determine  the  exact  interval  of  convergence. 

(a  )Jfn2xn  (b)  XXn)" 


(c) 

(e)  £(£)*" 

(g)  £(^r)^ 


(d)  £(fv)xn 

(f)  E((n+1)22"  )X 

(h)  Z(££)xn 


23.2  Repeat  Exercise  23.1  for  the  following: 

(a)  Vnxn  (b)  X  ^xn 

(c)  Xx"!  (d)X^*2"+1 

23.3  Find  the  exact  interval  of  convergence  for  the  series  in  Example  6. 

23.4  For  n  =  0, 1, 2, 3, . . .,  let  an  =  [ThgfizfT  ]n. 

(a)  Find  limsup(arl)1/ra,  liminf(art)1/,?1,  limsupl^^-l  and  liminf 

1  an  I 

(b)  Do  the  series  Xan  and  X(—  l)nhre  converge?  Explain  briefly. 


(c)  Now  consider  the  power  series  X  anXn  with  the  coefficients  an 
as  above.  Find  the  radius  of  convergence  and  determine  the 
exact  interval  of  convergence  for  the  series. 


23.5  Consider  a  power  series  X  anXn  with  radius  of  convergence  R. 

(a)  Prove  that  if  all  the  coefficients  an  are  integers  and  if  infinitely 
many  of  them  are  nonzero,  then  R  <  1. 


(b)  Prove  t licit  if  lim  sup  1 0-77,  |  0,  then  R  ^  1. 
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23.6  (a)  Suppose  anXn  has  finite  radius  of  convergence  R  and  an>  0 

for  all  n.  Show  that  if  the  series  converges  at  R ,  then  it  also 
converges  at  —R. 

(b)  Give  an  example  of  a  power  series  whose  interval  of  convergence 
is  exactly  (—1,1]. 

The  next  three  exercises  are  designed  to  show  that  the  notion  of 
convergence  of  functions  discussed  prior  to  Example  8  has  many 
defects. 

23.7  For  each  n  £  N,  let  fn(x)  =  (cosx)".  Each  fn  is  a  continuous 
function.  Nevertheless,  show 

(a)  lim/„(x)  =  0  unless  a:  is  a  multiple  of  7r, 

(b)  lim/„(a;)  =  1  if  x  is  an  even  multiple  of  7r, 

(c)  lim/n(x)  does  not  exist  if  x  is  an  odd  multiple  of  it. 

23.8  For  each  n  £  N,  let  fn(x)  =  ^sinnx.  Each  fn  is  a  differentiable 
function.  Show 

(a)  lim/n(x)  =  0  for  all  x  £  M, 

(b)  But  lim/^(x)  need  not  exist  [at  x  =  it  for  instance]. 

23.9  Let  fn(x )  =  nxn  for  x  £  [0, 1]  and  n  £  N.  Show 

(a)  lim/n(x)  =  0  for  x  £  [0, 1).  Hint :  Use  Exercise  9.12. 

(b)  However,  lim^oo  fQ  fn(x)  dx  =  1. 

§24  Uniform  Convergence 

We  first  formalize  the  notion  of  convergence  discussed  prior  to 
Example  8  in  the  preceding  section. 

24.1  Definition. 

Let  (fn)  be  a  sequence  of  real-valued  functions  defined  on  a  set  S  C 
K.  The  sequence  (fn)  converges  pointwise  [i.e.,  at  each  point]  to  a 
function  /  defined  on  S  if 

lim  fn(x )  =  f(x)  for  all  x  £  S. 

n— >•  oo 

We  often  write  lim/n  =  /  pointwise  [on  S']  or  fn  — >  /  pointwise 
[on  S]. 
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Example  1 

All  the  functions  /  obtained  in  the  last  section  as  a  limit  of  a  se¬ 
quence  of  functions  were  pointwise  limits.  See  Example  8  of  §23  and 
Exercises  23.7-23.9.  In  Exercise  23.8  we  have  fn  — >  0  pointwise  on 
K,  and  in  Exercise  23.9  we  have  fn  — >  0  pointwise  on  [0, 1).  □ 

Example  2 

Let  fn(x)  =  xn  for  x  €  [0, 1].  Then  /„  — >  f  pointwise  on  [0, 1]  where 
f(x)  =  0  for  x  G  [0, 1)  and  /( 1)  =  1.  □ 

Now  observe  fn  ►  /  pointwise  on  S  means  exactly  the  following: 

for  each  e  >  0  and  x  in  S  there  exists  N  such  that  ,  , 

|  fn(x)  -  f  0)|  <  e  for  n  >  N. 

Note  the  value  of  N  depends  on  both  e  >  0  and  x  in  S.  If  for  each 
e  >  0  we  could  find  N  so  that 

|  fn(x)  —  f(x) |  <  e  for  all  x  G  S  and  n  >  N, 

then  the  values  fn(x)  would  be  “uniformly”  close  to  the  values  f(x). 
Here  N  would  depend  on  e  but  not  on  x.  This  concept  is  extremely 
useful. 

24.2  Definition. 

Let  (fn)  be  a  sequence  of  real-valued  functions  defined  on  a  set 
S  CM.  The  sequence  (fn)  converges  uniformly  on  S  to  a  function  / 
defined  on  S  if 

for  each  e  >  0  there  exists  a  number  N  such  that  ,  . 

|  fn(x)  —  f(x) |  <  e  for  all  x  E  S  and  all  n  >  N. 

We  write  lim  fn  =  f  uniformly  on  S  or  fn  — >■  /  uniformly  on  S. 

Note  that  if  /n  — >  /  uniformly  on  S  and  if  e  >  0,  then  there  exists 
N  such  that  f(x)  —  e  <  fn(x)  <  f(x)  +  e  for  all  x  €  S  and  n  >  N. 
In  other  words,  for  n  >  N  the  graph  of  fn  lies  in  the  strip  between 
the  graphs  of  /  —  e  and  /  +  e.  In  Fig.  24.1  the  graphs  of  fn  for  n  >  N 
would  all  lie  between  the  dotted  curves. 

We  return  to  our  earlier  examples. 
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y 


Example  3 

Let  fn(x)  =  (1  —  \x\)n  for  x  G  (—1, 1).  Also,  let  f{x)  =  0  for  x  ^  0  and 
/( 0)  =  1.  As  noted  in  Example  8  of  §23,  /„  — >  /  pointwise  on  (—1, 1). 
It  turns  out  that  the  sequence  (/„)  does  not  converge  uniformly  to 
/  on  (—1,1)  in  view  of  the  next  theorem.  This  can  also  be  shown 
directly,  as  follows.  Assume  fn  — >  f  uniformly  on  (— 1, 1).  Then  [with 
e  =  \  in  mind]  we  see  there  exists  N  in  N  so  that  \f(x)  —  fn(x)\  <  \ 
for  all  x  6  (—1, 1)  and  n  >  N.  Hence 

x  G  (0, 1)  and  n>N  imply  |(1  —  x)n\  < 

In  particular, 

x  G  (0, 1)  implies  (1  —  <  -. 

However,  this  fails  for  sufficiently  small  x\  for  example,  if  we  set 
x  =  1  —  2-1/(Ar+1),  then  \  —  x  =  2_1AAr+1)  and  (1  —  x)N+1  =  2~1  = 
This  contradiction  shows  (fn)  does  not  converge  uniformly  to  /  on 
(— 1, 1)  as  had  been  assumed.  □ 

Example  4 

Let  fn(x)  =  L  sin  nx  for  x  G  M.  Then  fn  — >  0  pointwise  on  M  as 
shown  in  Exercise  23.8.  In  fact,  fn  — >  0  uniformly  on  M.  To  see  this, 
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let  e  >  0  and  let  N  =  Then  for  n  >  N  and  all  x  E  K  we  have 


I  fn(x)  -  0|  = 


1 

—  sin  nx 
n 


1  1 

<  -  <  —  =  e. 
n  N 


□ 


Example  5 

Let  fn(x )  =  nx 71  for  x  E  [0,1).  Since  Hindoo  /n(l)  =  lim^oo  n  = 
+oo,  we  have  dropped  the  number  1  from  the  domain  under  consid¬ 
eration.  Then  fn-+  0  pointwise  on  [0, 1),  as  shown  in  Exercise  23.9. 
We  show  the  convergence  is  not  uniform.  If  it  were,  there  would  exist 
IV  in  N  such  that 

| nxn  —  0|  <  1  for  all  x  E  [0, 1)  and  n  >  N. 

In  particular,  we  would  have  ( N  +  <  1  for  all  x  E  [0, 1). 

But  this  fails  for  x  sufficiently  close  to  1.  Consider,  for  example,  the 
reciprocal  x  of  (IV  +  l)1/!^1).  □ 

Example  6 

As  in  Example  2,  let  fn(x)  =  xn  for  x  E  [0,1],  f(x)  =  0  for  x  E 
[0, 1)  and  /( 1)  =  1.  Then  fn  — »  /  pointwise  on  [0, 1],  but  (/n)  does 
not  converge  uniformly  to  /  on  [0, 1],  as  can  be  seen  directly  or  by 
applying  the  next  theorem.  □ 

24.3  Theorem. 

The  uniform  limit  of  continuous  functions  is  continuous.  More  pre¬ 
cisely,  let  (/n)  be  a  sequence  of  functions  on  a  set  SCI,  suppose 
fn  f  uniformly  on  S,  and  suppose  S  =  dom(/).  If  each  fn  is 
continuous  at  x$  in  S,  then  f  is  continuous  at  xq.  [So  if  each  fn  is 
continuous  on  S,  then  f  is  continuous  on  5.] 

Proof 

This  involves  the  famous  argument.”  The  critical  inequality  is 

I  f{x)  -  f(x  o)|  <  I  f(x)  -  fn(x)  I  +  I  fn(x)  -  fn(x  0)|  +  \fn(x0)  -  f  (x0)  |. 

(1) 

If  n  is  large  enough,  the  first  and  third  terms  on  the  right  side  of  (1) 
will  be  small,  since  fn  — >  f  uniformly.  Once  such  n  is  selected,  the 
continuity  of  fn  implies  that  the  middle  term  will  be  small  provided 
x  is  close  to  Xq- 
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For  the  formal  proof,  let  e  >  0.  There  exists  N  in  N  such  that 
n  >  N  implies  | fn(x)  —  f(x)\  <  -  for  all  ifS. 

In  particular, 

\fN+i(x)  -  f(x)\  <  -  for  all  x  G  S.  (2) 

Since  /n+i  is  continuous  at  xq  there  is  a  <5  >  0  such  that 

x€  S  and  |x-x0|<<5  imply  \fN+1(x)  -  fN+i{x0)\  <  (3) 

see  Theorem  17.2.  Now  we  apply  (1)  with  n  =  N  + 1,  (2)  twice  [once 
for  x  and  once  for  xq]  and  (3)  to  conclude 

ifS  and  \x  —  xo|  <  S  imply  |  f(x)  —  f(x  o)|  <  3  •  -  =  e. 

3 

This  proves  that  /  is  continuous  at  xq.  ■ 


One  might  think  this  theorem  would  be  useless  in  practice,  since 
it  should  be  easier  to  show  a  single  function  is  continuous  than 
to  show  a  sequence  ( fn )  consists  of  continuous  functions  and  the 
sequence  converges  to  /  uniformly.  This  would  no  doubt  be  true  if 
/  were  given  by  a  simple  formula.  But  consider,  for  example, 

oo  1 

f(x)  =  Y  —^xn  for  x  G  [—1,1] 
z — '  nz 

n— 1 


or 


t  \  ^  (-i n^2n 

Mx)  =  2^ - 

n= 0 


(n!)2 


for 


The  partial  sums  are  clearly  continuous,  but  neither  /  nor  Jo  is  given 
by  a  simple  formula.  Moreover,  many  functions  that  arise  in  mathe¬ 
matics  and  elsewhere,  such  as  the  Bessel  function  Jo,  are  defined  by 
power  series.  It  would  be  very  useful  to  know  when  and  where  power 
series  converge  uniformly;  an  answer  is  given  in  §26. 


24.4  Remark. 

Uniform  convergence  can  be  reformulated  as  follows.  A  sequence  ( fn ) 
of  functions  on  a  set  S  Cl  converges  uniformly  to  a  function  f  on 
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S  if  and  only  if 

lim  sup{|  f(x)  -  fn(x)  |  :i£S}  =  0.  (1) 

n— >oo 

We  leave  the  straightforward  proof  to  Exercise  24.12. 

According  to  (1)  we  can  decide  whether  a  sequence  (fn)  con¬ 
verges  uniformly  to  /  by  calculating  sup{|/(x)  —  fn(x) |  :  x  6  S}  for 
each  n.  If  /  —  fn  is  differentiable,  we  may  use  calculus  to  find  these 
suprema.  □ 


Example  7 

Let  fn(x )  =  1+xnx,  for  Clearly  we  have  lim^oo  fn( 0)  =  0.  If 

i^O,  then  limn_>00(l  +  nx2)  =  +oo,  so  lim,woo/n(x)  =  0.  Thus 
/n  — >  0  pointwise  on  M.  To  find  the  maximum  and  minimum  of  fn, 
we  calculate  f'n{x)  and  set  it  equal  to  0.  This  leads  to  (1  +  nx2)  ■  1 
—x{2 nx)  =  0  or  1  —  nx2  =  0.  Thus  fn(x)  =  0  if  and  only  if  x  =  ^=. 
Further  analysis  or  a  sketch  of  fn  leads  one  to  conclude  fn  takes  its 
maximum  at  -4=  and  its  minimum  at  — 7= .  Since  \  ±  -4=  )  =  ±  ■ 

Vn  y/n  Jn\  s/n)  2  ^fn' 

we  conclude 

lim  sup{ | fn(x) |  :xeS}  =  lim  —^=  =  0. 

n— »oo  iho o  ZWn 

Therefore  /n  — >  0  uniformly  on  M  by  Remark  24.4.  □ 


Example  8 

Let  fn(x)  =  n2xn{l—x)  for  x  €  [0, 1].  Then  we  have  limn_>.0O  fn (1)  =  0. 
For  x  €  [0, 1)  we  have  lim^oo  n2xn  =  0  by  applying  Exercise  9.12, 
since  for  r^O, 

(n  +  l)2xn+1  fn+1 

n2xn  V  n 


v 

I  x  — >  x. 


Hence  limn_>,00  fn(x)  =  0.  Thus  fn  — >  0  pointwise  on  [0, 1].  Again,  to 
find  the  maximum  and  minimum  of  fn  we  set  its  derivative  equal  to 
0.  We  obtain  xn(— 1)  +  (1  —  x)nx11^1  =  0  or  xn~l[n  —  (n  +  l)x)  =  0. 
Since  fn  takes  the  value  0  at  both  endpoints  of  the  interval  [0, 1],  it 
follows  that  fn  takes  it  maximum  at  zffr-  We  have 


fn 


n 


n+  1 


n 


n  \ 
n  +  1 ) 


n 


2 


n  +  1 
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The  reciprocal  of  {^W)n  is  (l  +  ^)n,  the  nth  term  of  a  sequence  which 
has  limit  e.  This  was  mentioned,  but  not  proved,  in  Example  3  of  §7; 

a  proof  is  given  in  Theorem  37.11.  Therefore  we  have  lim(^-j-)?l  = 

2 

Since  lim[^pp]  =  +oo,  we  conclude  from  (1)  that  lim/n(^-j-)  =  +oo; 
see  Exercise  12.9(a).  In  particular,  limsup{|/n(a;)|  :  x  G  [0,1]}  = 
Too,  so  (fn)  does  not  converge  uniformly  to  0  on  [0, 1].  □ 

Exercises 

24.1  Let  fn{x)  =  1+2 ^nx .  Prove  carefully  that  (/„)  converges 

uniformly  to  0  on  K. 

24.2  For  x  G  [0,oo),  let  fn(x)  =  T 

(a)  Find  f(x)  =  lim/n(a:). 

(b)  Determine  whether  fn—>f  uniformly  on  [0,1]. 

(c)  Determine  whether  fn  — >  f  uniformly  on  [0,  oo). 

24.3  Repeat  Exercise  24.2  for  fn(x)  =  1+13,n . 

24.4  Repeat  Exercise  24.2  for  fn(x)  =  yy-sr- 

24.5  Repeat  Exercise  24.2  for  fn(x)  =  n+xn  ■ 

24.6  Let  fn(x )  =  (x  -  ^)2  for  x  G  [0, 1]. 

(a)  Does  the  sequence  (/„)  converge  pointwise  on  the  set  [0, 1]?  If 
so,  give  the  limit  function. 

(b)  Does  (fn)  converge  uniformly  on  [0, 1]?  Prove  your  assertion. 

24.7  Repeat  Exercise  24.6  for  fn(x)  =  x  —  xn . 

24.8  Repeat  Exercise  24.6  for  fn(x)  =  J2k=oxk- 

24.9  Consider  fn(x)  =  nxn(  1  —  x)  for  x  G  [0, 1]. 

(a)  Find  f(x)  =  lim/„(z). 

(b)  Does  /„—>■/  uniformly  on  [0, 1]?  Justify. 

(c)  Does  fn(x)  dx  converge  to  JQ'  f(x)  dx?  Justify. 

24.10  (a)  Prove  that  if  fn  — >  f  uniformly  on  a  set  S,  and  gn  g 
uniformly  on  S,  then  fn+9n~^f  +  9  uniformly  on  S. 
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(b)  Do  you  believe  the  analogue  of  (a)  holds  for  products?  If  so,  see 
the  next  exercise. 

24.11  Let  fn(x)  =  x  and  gn(x)  =  77  for  all  x  £  R.  Let  f(x)  =  x  and 
g(x)  =  0  for  x  €  R. 

(a)  Observe  /„—>•/  uniformly  on  R  [obvious!]  and  gn  — >■  g 
uniformly  on  R  [almost  obvious]. 

(b)  Observe  the  sequence  ( fngn )  does  not  converge  uniformly  to  fg 
on  R.  Compare  Exercise  24.2. 

24.12  Prove  the  assertion  in  Remark  24.4. 

24.13  Prove  that  if  (/„)  is  a  sequence  of  uniformly  continuous  functions 
on  an  interval  (a,  6),  and  if  fn  — >  f  uniformly  on  (a,  6),  then  /  is 
also  uniformly  continuous  on  (a,  b).  Hint:  Try  an  |  argument  as  in 
the  proof  of  Theorem  24.3. 

24.14  Let  fn(x)  =  1+nJ.x2  and  f{x)  =  0  for  x  £  R. 

(a)  Show  fn—*f  pointwise  on  R. 

(b)  Does  /„—>■/  uniformly  on  [0, 1]?  Justify. 

(c)  Does  fn—>f  uniformly  on  [1,  00)?  Justify. 

24.15  Let  fn(x)  =  for  x  €  [0,oo). 

(a)  Find  f{x)  =  lim  fn(x). 

(b)  Does  /„—>•/  uniformly  on  [0, 1]?  Justify. 

(c)  Does  /„—>•/  uniformly  on  [1,  00)?  Justify. 

24.16  Repeat  Exercise  24.15  for  fn(x)  =  1^x2  • 

24.17  Let  (/„)  be  a  sequence  of  continuous  functions  on  [a,  6]  that  con¬ 
verges  uniformly  to  /  on  [a,  b}.  Show  that  if  (xn)  is  a  sequence  in 
[a,  6]  and  if  xn  ->•  x,  then  lim^oo  fn(xn)  =  f(x). 


§25  More  on  Uniform  Convergence 

Our  next  theorem  shows  one  can  interchange  integrals  and  uni¬ 
form  limits.  The  adjective  “uniform”  here  is  important;  compare 
Exercise  23.9. 
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25.1  Discussion. 

To  prove  Theorem  25.2  below  we  merely  use  some  basic  facts  about 
integration  which  should  be  familiar  [or  believable]  even  if  your 
calculus  is  rusty.  Specifically,  we  use: 

(a)  If  g  and  h  are  integrable  on  [a,b]  and  if  g(x)  <  h(x)  for  all 
x  €  [a,  b],  then  J^g(x)dx  <  J'f  h(x)  dx.  See  Theorem  33.4(i). 

We  also  use  the  following  corollary: 

(b)  If  g  is  integrable  on  [a,  b],  then 


g(x)  dx 


<  [  I g(x)\dx. 


Continuous  functions  on  closed  intervals  are  integrable,  as  noted 
in  Discussion  19.3  and  proved  in  Theorem  33.2.  □ 


25.2  Theorem. 

Let  (fn)  be  a  sequence  of  continuous  functions  on  [a,b\,  and  suppose 
fn—tf  uniformly  on  [a,  6].  Then 

fn(x)dx=  I  f(x)  dx.  (1) 

J  a 

Proof 

By  Theorem  24.3  /  is  continuous,  so  the  functions  fn  —  f  are  all 
integrable  on  [a,  b ].  Let  e  >  0.  Since  fn—tf  uniformly  on  [a,  b ],  there 
exists  a  number  N  such  that  \fn(x)  —  f(x)\  <  for  all  x  £  [a,  b] 
and  all  n  >  N .  Consequently  n  >  N  implies 


fb 

lim  / 
Ja 


[b 

rb 

rb 

/  fn(x)dx~ 

/  f{x)  dx 

= 

/  [fn(x)  -  f(x)\dx 

J  a 

J  a 

J  a 

< 


=  e. 


The  first  <  follows  from  Discussion  25.1(b)  applied  to  g  =  fn~f  and 
the  second  <  follows  from  Discussion  25.1(a)  applied  to  g  =  \  fn  —  /] 
and  h  =  -rf-\  h  happens  to  be  a  constant  function,  but  this  does  no 
harm. 

The  last  paragraph  shows  that  given  e  >  0,  there  exists  N 
such  that  |  fn(x)dx  —  J'f  f(x)  dx\  <  e  for  n  >  N.  Therefore  (1) 
holds.  ■ 
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Recall  one  of  the  advantages  of  the  notion  of  Cauchy  sequence: 
A  sequence  (sn)  of  real  numbers  can  be  shown  to  converge  without 
knowing  its  limit  by  simply  verifying  that  it  is  a  Cauchy  sequence. 
Clearly  a  similar  result  for  sequences  of  functions  would  be  valuable, 
since  it  is  likely  that  we  will  not  know  the  limit  function  in  advance. 
What  we  need  is  the  idea  of  “uniformly  Cauchy.” 

25.3  Definition. 

A  sequence  (/n)  of  functions  defined  on  a  set  S  C  M  is  uniformly 
Cauchy  on  S  if 

for  each  e  >  0  there  exists  a  number  N  such  that  ,  . 

|  fn(x)  —  fm{x)\  <  e  for  all  x  G  S  and  all  m,n  >  N. 

Compare  this  definition  with  that  of  a  Cauchy  sequence  of  real 
numbers  [Definition  10.8]  and  that  of  uniform  convergence  [Defi¬ 
nition  24.2].  It  is  an  easy  exercise  to  show  uniformly  convergent 
sequences  of  functions  are  uniformly  Cauchy;  see  Exercise  25.4.  The 
interesting  and  useful  result  is  the  converse,  just  as  in  the  case  of 
sequences  of  real  numbers. 

25.4  Theorem. 

Let  ( fn )  he  a  sequence  of  functions  defined  and  uniformly  Cauchy  on 
a  set  S  C  K.  Then  there  exists  a  function  f  on  S  such  that  /n  — »  / 
uniformly  on  S. 

Proof 

First  we  have  to  “find”  /.  We  begin  by  showing 

for  each  xo  €  S  the  sequence  (fn(x o))  is  a  Cauchy  ,  , 
sequence  of  real  numbers.  ' 

For  each  e  >  0,  there  exists  N  such  that 

I  fn  (,x)  —  fm(x)  |  <  e  for  x  E  S  and  m,n  >  N. 

In  particular,  we  have 

\fn(x0)  -  fm(x o)|  <  £  for  m, n  >  N. 

This  shows  (fn(x o))  is  a  Cauchy  sequence,  so  (1)  holds. 
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Now  for  each  x  in  S,  assertion  (1)  implies  limn_5.0O  fn(x)  exists; 
this  is  proved  in  Theorem  10.11  which  in  the  end  depends  on  the 
Completeness  Axiom  4.4.  Hence  we  define  f(x)  =  lin^^oo  fn(x). 
This  defines  a  function  f  on  S  such  that  fn~>f  pointwise  on  S. 

Now  that  we  have  “found”  /,  we  need  to  prove  fn~^f  uniformly 
on  S.  Let  e  >  0.  There  is  a  number  N  such  that 

|  fn(x)  —  fm(x)\  <  -  for  all  x  €  S  and  all  m,n  >  N.  (2) 

Consider  m  >  N  and  x  E  S.  Assertion  (2)  tells  us  that  fn(x)  lies  in 
the  open  interval  (fm(x)  —  §,/m.(x)  +  |)  for  all  n  >  N.  Therefore, 
as  noted  in  Exercise  8.9,  the  limit  f(x)  =  limn^oo  fn(x)  lies  in  the 
closed  interval  [fm(x)  —  |,  fm{x)  +  |].  In  other  words, 

|  f(x)  —  fm(x) |  <  y  for  all  x  6  S  and  m  >  N. 

Then  of  course 

| f(x)  —  fm{x) |  <  e  for  all  and  m  >  N. 

This  shows  fm  — >  f  uniformly  on  S,  as  desired.  ■ 


Theorem  25.4  is  especially  useful  for  “series  of  functions.”  Let  us 
recall  what  ak  signifies  when  the  a*,’ s  are  real  numbers.  This 

signifies  lim^oo  Ylk=i  ak  provided  this  limit  exists  [as  a  real  number, 
Too  or  — oo].  Otherwise  the  symbol  ak  has  no  meaning.  Thus 

the  infinite  series  is  the  limit  of  the  sequence  of  partial  sums  ak- 

Similar  remarks  apply  to  series  of  functions.  A  series  of  functions  is 
an  expression  9k  or  J2h=o  9k(x)  which  makes  sense  provided 

the  sequence  of  partial  sums  Ylk=o9k  converges,  or  diverges  to  Too 
or  —  oo  pointwise.  If  the  sequence  of  partial  sums  converges  uniformly 
on  a  set  S  to  Ylk^o  9k->  then  we  say  the  series  is  uniformly  convergent 
on  S. 


Example  1 

Any  power  series  is  a  series  of  functions,  since  akxk  has  the 

form  YlkLoSk  where  fl'fc(x)  =  for  all  x.  □ 


204  Sequences  and  Series  of  Functions 


y 


FIGURE  25.1 


Example  2 

YlT=o  i+xk  *s  a  series  °f  functions,  but  is  not  a  power  series,  at  least 

not  in  its  present  form.  This  is  a  series  YlkLoSk  where  9o(x)  =  \  f°r 

2 

all  x.  gi(x)  =  for  all  x,  g-Ax)  =  for  all  x,  etc.  □ 


Example  3 

Let  g  be  the  function  drawn  in  Fig.  25.1,  and  let  gn(x)  =  g( 4nx)  for 
all  x  €  M.  Then  X]^=o(f)Tl 9n(x)  a  series  of  functions.  The  limit 
function  /  is  continuous  on  M,  but  has  the  amazing  property  that  it  is 
not  differentiable  at  any  point!  The  proof  of  the  nondifferentiability 
of  /  is  somewhat  delicate;  see  [62,  7.18].  A  similar  example  is  given 
in  Example  38.1  on  page  348.  □ 


Theorems  for  sequences  of  functions  translate  easily  into  theo¬ 
rems  for  series  of  functions.  Here  is  an  example. 

25.5  Theorem. 

Consider  a  series  Y!kLo9k  of  functions  on  a  set  S  C  M.  Suppose 
each  gk  is  continuous  on  S  and  the  series  converges  uniformly  on  S. 
Then  the  series  9k  represents  a  continuous  function  on  S. 

Proof 

Each  partial  sum  fn  =  Ylk=i  9k  is  continuous  and  the  sequence  (fn) 
converges  uniformly  on  S.  Hence  the  limit  function  is  continuous  by 
Theorem  24.3.  ■ 
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Recall  the  Cauchy  criterion  for  series  22  ak  given  in  Defini¬ 
tion  14.3: 

for  each  e  >  0  there  exists  a  number  N  such  that 
n  >  m  >  N  implies  |  22fc=m  ak\  <  e. 

The  analogue  for  series  of  functions  is  also  useful.  The  sequence  of 
partial  sums  of  a  series  22a*L o  9k  of  functions  is  uniformly  Cauchy 
on  a  set  S  if  and  only  if  the  series  satisfies  the  Cauchy  criterion 
[ uniformly  on  5]: 

for  each  e  >  0  there  exists  a  number  N  such  that 
n  >  m  >  N  implies  |  22fc=m  9k(x)\  <  e  for  all  x  €  S. 

25.6  Theorem. 

If  a  series  22^Lo  9k  °f  functions  satisfies  the  Cauchy  criterion 
uniformly  on  a  set  S,  then  the  series  converges  uniformly  on  S . 

Proof 

Let  fn  =  ELo  9k-  The  sequence  (fn)  of  partial  sums  is  uni¬ 
formly  Cauchy  on  S,  so  (/n)  converges  uniformly  on  S  by 
Theorem  25.4.  ■ 

Here  is  a  useful  corollary. 

25.7  Weierstrass  M-test. 

Let  (Mk)  be  a  sequence  of  nonnegative  real  numbers  where  22  Tffc  < 
oo.  If  \gk(x)\  <  Mk  for  all  x  in  a  set  S,  then  22 9k  converges 
uniformly  on  S. 

Proof 

To  verify  the  Cauchy  criterion  on  S,  let  e  >  0.  Since  the  series  22  Tffc 
converges,  it  satisfies  the  Cauchy  criterion  in  Definition  14.3.  So  there 
exists  a  number  N  such  that 

n 

n  >  m  >  N  implies  Mk  <  e. 

k=m 

Hence  if  n  >  m  >  N  and  x  is  in  S,  then 

n  n  n 

^2  9k(x )  <  ^2  \9k(x)\  <  ^2  Mk  <  e- 

k=m  k=m  k=m 
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Thus  the  series  Y  g/c  satisfies  the  Cauchy  criterion  uniformly  on  S, 
and  Theorem  25.6  shows  it  converges  uniformly  on  S.  ■ 

Example  4 

Show  2~nxn  represents  a  continuous  function  /  on  (—2,  2),  but 

the  convergence  is  not  uniform.  □ 


Solution 

This  is  a  power  series  with  radius  of  convergence  2.  Clearly  the  series 
does  not  converge  at  x  =  2  or  at  x  =  —2,  so  its  interval  of  convergence 
is  (-2,2). 

Consider  0  <  a  <  2  and  note  Y™=i  2-nan  =  Yn Li(§)n  con- 
verges.  Since  \2~nxn\  <  2 ~nan  =  (|)n  for  x  6  [—a,  a],  the  Weierstrass 
M-test  25.7  shows  the  series  2~nxn  converges  uniformly  to  a 

function  on  [—a,  a].  By  Theorem  25.5  the  limit  function  /  is  contin¬ 
uous  at  each  point  of  the  set  [—a,  a].  Since  a  can  be  any  number  less 
than  2,  we  conclude  /  represents  a  continuous  function  on  (—2,2). 

Since  we  have  sup{|2_n.xn|  :  x  E  (—2,2)}  =  1  for  each  n,  the 
convergence  of  the  series  cannot  be  uniform  on  (—2, 2)  in  view  of  the 
next  example.  □ 


Example  5 

Show  that  if  the  series  Y  9n  converges  uniformly  on  a  set  S,  then 


lim  sup{|<?n(x)|  :  x  E  S}  =  0. 

n— >oo 


Solution 

Let  e  >  0.  Since  the  series  Y  9n  satisfies  the  Cauchy  criterion,  there 
exists  N  such  that 


n  >  m  >  N  implies 
In  particular, 


n 

9k(x) 

k=m 


<  e 


for  all  x  E  S. 


n  >  N  implies  \gn(x)\  <  e  for  all  x  E  S. 


Therefore 


n  >  N  implies  sup{|gn(x)|  :  x  E  S}  <  e. 
This  establishes  (1). 


□ 
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Exercises 

25.1  Derive  Discussions  25.1(b)  from  25.1(a).  Hint :  Apply  (a)  twice,  once 
to  g  and  |<?|  and  once  to  —  |p|  and  g. 

25.2  Let  fn(x)  =  Show  (/„)  is  uniformly  convergent  on  [—1,1]  and 
specify  the  limit  function. 

25.3  Let  fn(x)  =  ara+stoTr  for  all  real  numbers  x. 

(a)  Show  (/„)  converges  uniformly  on  R.  Hint :  First  decide  what 
the  limit  function  is;  then  show  (/„)  converges  uniformly  to  it. 

(b)  Calculate  lim^oo  fj  fn(x)  dx.  Hint:  Don’t  integrate  fn. 

25.4  Let  (/„)  be  a  sequence  of  functions  on  a  set  S  C  R,  and  suppose 
fn—tf  uniformly  on  S.  Prove  (fn)  is  uniformly  Cauchy  on  S.  Hint: 
Use  the  proof  of  Lemma  10.9  on  page  63  as  a  model,  but  be  careful. 

25.5  Let  (fn)  be  a  sequence  of  bounded  functions  on  a  set  S,  and  suppose 
fn—tf  uniformly  on  S.  Prove  /  is  a  bounded  function  on  S. 

25.6  (a)  Show  that  if  )T)  \a,k\  <  00,  then  a,kXk  converges  uniformly  on 

[—1,1]  to  a  continuous  function. 

(b)  Does  i^xn  represent  a  continuous  function  on  [—1, 1]? 

25.7  Show  -v  cos  nx  converges  uniformly  on  I  to  a  continuous 

function. 

25.8  Show  ^§2^  bas  radius  of  convergence  2  and  the  series 

converges  uniformly  to  a  continuous  function  on  [—2,2]. 

25.9  (a)  Let  0  <  a  <  1.  Show  the  series  Yl°^=oxn  converges  uniformly 

on  [-a,  a]  to 

(b)  Does  the  series  xU  converge  uniformly  on  (—1, 1)  to  yzy? 

Explain. 

25.10  (a)  Show  converges  for  x  G  [0, 1). 

(b)  Show  that  the  series  converges  uniformly  on  [0,a]  for  each  a, 
0  <  a  <  1. 


(c)  Does  the  series  converge  uniformly  on  [0, 1)?  Explain. 

25.11  (a)  Sketch  the  functions  go,  g  1,  32  and  33  in  Example  3. 
(b)  Prove  the  function  /  in  Example  3  is  continuous. 
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25.12  Suppose  9k  is  a  series  of  continuous  functions  gu  on  [a,  6]  that 

converges  uniformly  to  g  on  [a,  ft].  Prove 


25.13  Suppose  9k  and  52fcli  bk  converge  uniformly  on  a  set  S.  Show 
SfcLi  (9k  +  hk)  converges  uniformly  on  S. 

25.14  Prove  that  if  'ffgk  converges  uniformly  on  a  set  S  and  if  ft  is  a 
bounded  function  on  S,  then  52  hgk  converges  uniformly  on  S. 

25.15  Let  (/„)  be  a  sequence  of  continuous  functions  on  [a,  ft]. 

(a)  Suppose  that,  for  each  x  in  [a,  6],  (/„( x))  is  a  decreasing  se¬ 
quence  of  real  numbers.  Prove  that  if  fn  — *■  0  pointwise  on 
[a,  6],  then  /„  — *■  0  uniformly  on  [a,  ft].  Hint :  If  not,  there  exists 
e  >  0  and  a  sequence  (xn)  in  [a,  ft]  such  that  fn{xn)  >  e  for  all 
n.  Obtain  a  contradiction. 

(b)  Suppose  that,  for  each  x  in  [a,  6],  (/ra(x))  is  an  increasing  se¬ 
quence  of  real  numbers.  Prove  that  if  fn  — *■  /  pointwise  on  [a,  b] 
and  if  /  is  continuous  on  [a,  ft],  then  /„—>■/  uniformly  on  [a,  b\. 
This  is  Dini’s  theorem. 

§26  Differentiation  and  Integration  of  Power 
Series 

The  following  result  was  mentioned  in  §23  after  Example  8. 

26.1  Theorem. 

Let  anXn  be  a  power  series  with  radius  of  convergence  R  >  0 

[possibly  R  =  +oo] .  If  0  <  R\  <  R,  then  the  power  series  converges 

uniformly  on  [— R±,Ri]  to  a  continuous  function. 


Proof 


Consider  0  <  R\  <  R.  A  glance  at  Theorem  23.1  shows  the  se¬ 
ries  YlanXn  and  Yl\an\xn  have  the  same  radius  of  convergence, 
since  /?  and  R  are  defined  in  terms  of  |an|.  Since  |i?i|  <  R,  we 
have  52  \an\R\  <  oo.  Clearly  we  have  |anxn|  <  \an\Rf  for  all  x  in 
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[— Ri,  R\],  so  the  series  22  anxn  converges  uniformly  on  [— R\,  i?i]  by 
the  Weierstrass  M-test  25.7.  The  limit  function  is  continuous  at  each 
point  of  [— Ri,R\]  by  Theorem  25.5.  ■ 

26.2  Corollary. 

The  power  series  22  omxn  converges  to  a  continuous  function  on  the 
open  interval  (—R,R). 

Proof 

If  xo  £  (— R ,  R),  then  xo  £  (— R±,  R\)  for  some  R\  <  R.  The  theorem 
shows  the  limit  of  the  series  is  continuous  at  xq.  ■ 

We  emphasize  that  a  power  series  need  not  converge  uniformly 
on  its  interval  of  convergence  though  it  might;  see  Example  4  of  §25 
and  Exercise  25.8. 

We  are  going  to  differentiate  and  integrate  power  series  term- 
by-term,  so  clearly  it  would  be  useful  to  know  where  the  new  series 
converge.  The  next  lemma  tells  us. 

26.3  Lemma. 

If  the  power  series  22^1o  anXn  has  radius  of  convergence  R,  then  the 
power  series 

oo  oo 

nanxn~l  and  S'  ~^—xn+ 1 

^  ^  n  +  1 

n= 1  n= 0 

also  have  radius  of  convergence  R. 

Proof 

First  observe  the  series  22  nanx n~1  and  22  nanxn  have  the  same  ra¬ 
dius  of  convergence:  since  the  second  series  is  x  times  the  first  series, 
they  converge  for  exactly  the  same  values  of  x.  Likewise  22 
and  22  £+rxTl  have  the  same  radius  of  convergence. 

Next  recall  R  =  jj  where  /3  =  limsup  la^l1/".  For  the  se¬ 
ries  22  ™nsn,  we  consider  limsup(n|an|)1/n  =  limsupra1/"|an|1/n. 
By  Theorem  9.7(c)  on  page  48,  we  have  limn1/™  =  1,  so 

limsup(n|an|)1//n  =  (3  by  Theorem  12.1  on  page  78.  Hence  the  series 
22  nanxn  has  radius  of  convergence  R. 
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For  the  series  ^+ixn-,  we  consider  limsup(^p]-)1//n.  It  is  easy 
to  show  lim(n  +  l)1/*1  =  1;  therefore  lim(^q-j-)1/”  =  1.  Hence  by 

Theorem  12.1  we  have  hmsup(J^pj-)1/n  =  /3,  so  the  series  ^+lxU 
has  radius  of  convergence  R.  ■ 


26.4  Theorem. 

Suppose  f(x)  =  anXn  has  radius  of  convergence  R  >  0.  Then 

pcc  oo 

/  f(t)  dt  =  Y  an  xn+1  for  |x|  <  R.  (1) 

^  hn+l 

Proof 

We  fix  x  and  assume  x  <  0;  the  case  x  >  0  is  similar  [Exercise  26.1]. 
On  the  interval  [x,0],  the  sequence  of  partial  sums  YHt=oak^k 
converges  uniformly  to  f(t)  by  Theorem  26.1.  Consequently,  by 
Theorem  25.2  we  have 


The  second  equality  is  valid  because  we  can  interchange  integrals 
and  finite  sums;  this  is  a  basic  property  of  integrals  [Theorem  33.3]. 
Since  J'J  f(t )  dt  =  —  f(t )  dt ,  Eq.  (2)  implies  Eq.  (1).  ■ 

The  theorem  just  proved  shows  that  a  power  series  can  be  inte¬ 
grated  term-by-term  inside  its  interval  of  convergence.  Term-by-term 
differentiation  is  also  legal. 

26.5  Theorem. 

Let  f(x)  =  anXn  have  radius  of  convergence  R  >  0.  Then  f  is 

differentiable  on  (-R,  R)  and 

OO 

f'(x)  =  Y'J  nanxn~l  for  |x|  <  R. 

71=1 


(1) 
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The  proof  of  Theorem  26.4  was  a  straightforward  application  of 
Theorem  25.2,  but  the  direct  analogue  of  Theorem  25.2  for  deriva¬ 
tives  is  not  true  [see  Exercise  23.8  and  Example  4  of  §24],  So  we  give 
a  devious  indirect  proof  of  the  theorem. 


Proof 

We  begin  with  the  series  g{x)  =  nanxn  l  and  observe  this 

series  converges  for  |x|  <  R  by  Lemma  26.3.  Theorem  26.4  shows 
that  we  can  integrate  g  term-by-term: 


OO 

y ^an,xn 

n=  1 


f(x )  —  a o  for  |x|  <  R. 


Thus  if  0  <  R\  <  R,  then 

f{x)=  I  g(t)  dt  +  k  for  |x|  <  R±, 

J-Ri 

where  A:  is  a  constant;  in  fact,  k  =  ao  —  g(t)  dt.  Since  g  is  contin¬ 
uous,  one  of  the  versions  of  the  Fundamental  Theorem  of  Calculus 
[Theorem  34.3]  shows  /  is  differentiable  and  f'{x )  =  g(x).  Thus 

OO 

f'(x)  =  g{x)  =  nanxn~l  for  |x|  <  R. 

n= 1  h 


Example  1 

Recall 


E 


xn  = 


1 


n= 0 


1  —  X 

Differentiating  term-by-term,  we  obtain 
~  1 


for  Ixl  <  1. 


E 

n=  1 


nx11  1  = 


(1  —  x)2 


for  Ixl  <  1. 


Integrating  (1)  term-by-term,  we  get 


(1) 


^  1  f‘X  1 

E^TT X"+I  =  l  = 

n= 0 
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or 


n= 1 


Replacing  x  by  —x,  we  find 


,  XXX  I, 

loge(l  +  x)  =  x  -  —  +  — - —  H -  for  \x\  <  1.  (3) 


It  turns  out  that  this  equality  is  also  valid  for  x  =  1  [see  Example  2] , 
so  we  have  the  interesting  identity 


(4) 


In  Eq.  (2)  set  x  =  Then 


n 


m  —  1 


loge  1 


loge  m. 


m 


Hence  we  have 


for  all  m. 


Here  is  yet  another  proof  that  ::  =  +oo- 


□ 


To  establish  (4)  we  need  a  relatively  difficult  theorem  about 
convergence  of  a  power  series  at  the  endpoints  of  its  interval  of 
convergence. 

26.6  Abel’s  Theorem. 

Let  f(x)  =  anXn  be  a  power  series  with  finite  positive  radius  of 

convergence  R.  If  the  series  converges  atx  =  R,  then  f  is  continuous 
at  x  =  R.  If  the  series  converges  at  x  =  —  R,  then  f  is  continuous 
at  x  =  —R. 


Example  2 

As  promised,  we  return  to  (3)  in  Example  1: 
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For  x  =  1  the  series  converges  by  the  Alternating  Series  Theo¬ 
rem  15.3.  Thus  the  series  represents  a  function  /  on  (—1,1]  that  is 
continuous  at  x  =  1  by  Abel’s  theorem.  The  function  loge(l  +  x) 
is  also  continuous  at  x  =  1,  so  the  functions  agree  at  a:  =  1. 
[In  detail,  if  (xn)  is  a  sequence  in  (—1,1)  converging  to  1,  then 
/(l)  =  limn-^oo  f(xn)  =  limn_>.00  loge(l  +  xn)  =  loge2.]  Therefore 
we  have 


l°ge  2  =  1 


1 

4 


1 

5 


1 

6 


+  ■■■. 


Another  proof  of  this  identity  is  given  in  Example  2  of  §31.  □ 


Example  3 

Recall  En=oxn  =  yzy  for  M  <  1-  Note  that  at  x  =  —  1  the  function 
is  continuous  and  takes  the  value  However,  the  series  does 
not  converge  for  x  =  —1.  so  Abel’s  theorem  does  not  apply.  □ 


Proof  of  Abel’s  Theorem 

The  heart  of  the  proof  is  in  Case  1. 

Case  1.  Suppose  f(x)  =  Yl‘^LoanXn  has  radius  of  convergence  1 
and  the  series  converges  at  a;  =  1.  We  will  prove  /  is  continuous 
on  [0, 1].  By  subtracting  a  constant  from  /,  we  may  assume  /( 1)  = 

E^i 0an  =  0.  Let  fn{x)  =  Efe=0  akxk  and  sn  =  Efc=0  ak  =  fn(  1) 
for  n  =  0, 1,  2, . . ..  Since  fn(x)  — >  f(x)  pointwise  on  [0, 1]  and  each 
fn  is  continuous,  Theorem  24.3  on  page  196  shows  it  suffices  to  show 
fn  — *  /  uniformly  on  [0,1].  Theorem  25.4  on  page  202  shows  it 
suffices  to  show  the  convergence  is  uniformly  Cauchy. 

For  m  <  n,  we  have 


fn{x)  -  fm{x ) 


n  n 

^2  akXk  =  22  (Sfc  “  sk-i)xk 

k=m-\- 1  k=m-\- 1 

n  n 

22  skXk  -X  22  Sk-lXk~ 1 

k=m-\- 1  k=mJrl 

n  n—  1 

22  Skxk  ~ x  22 Skxk ’ 

k=m-\- 1  k=m 
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and  therefore 


71—1 


fn(x)-fm(x)  =  SnXn-SmXrn+1  +  (  1-X)  ^  SkXk. 

k=m+ 1 


(i) 


Since  lim  sn  =  ak  =  /(l)  =  0,  given  e  >  0,  there  is  an  integer  N 

so  that  |sn|  <  |  for  all  n  >  N.  Then  for  n  >  m  >  N  and  x  in  [0, 1), 
we  have 


n—  1 

(1  -  x)  ^2  Skxh 
k=m+l 


<  -(i 
-  3 v 


71—1 

x)  ^  x 

k=m+ 1 


k 


a  1  _  ^.n—m—1  , 

=  1(1-  x)xm+1- _ - _ <  - 

3  1  X)X  1-x  S' 


(2) 


The  first  term  in  inequality  (2)  is  also  less  than  |  for  x  =  1. 
Therefore,  for  n  >  m  >  N  and  x  in  [0, 1],  (1)  and  (2)  show 

I  fn{x)  -  fm{x)  I  <  \sn\xn  +  |sm|xm+1  +  |<|+^  +  ^=e. 

Thus  the  sequence  (fn)  is  uniformly  Cauchy  on  [0,1],  and  its  limit 
/  is  continuous. 


Case  2.  Suppose  f{x)  =  anXn  has  radius  of  convergence  R, 

0  <  R  <  oo,  and  the  series  converges  at  x  =  R.  Let  g(x)  =  f(Rx) 
and  note  that 

OO 

g(x )  =  ^anl?Tlxn  for  |x|  <  1. 

71—0 

This  series  has  radius  of  convergence  1,  and  it  converges  at  x  =  1. 
By  Case  1,  g  is  continuous  at  x  =  1.  Since  f(x)  =  g(  Jj),  it  follows 
that  /  is  continuous  at  x  =  R. 

Case  3.  Suppose  f(x)  =  anXn  has  radius  of  convergence  R, 

0  <  R  <  oo,  and  the  series  converges  at  x  =  —R.  Let  h(x)  =  f{—x) 
and  note  that 

OO 

h(x)  =  y~^(— 1  )nanxn  for  |a;|  <  R. 

71—0 

The  series  for  h  converges  at  x  =  R,  so  h  is  continuous  at  x  =  R  by 
Case  2.  It  follows  that  f(x)  =  h(—x)  is  continuous  at  x  =  —R.  _ 
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The  point  of  view  in  our  extremely  brief  introduction  to  power 
series  has  been:  For  a  given  power  series  £  anXn,  what  can  one  say 
about  the  function  f(x)  =  22  <^nXn^  This  point  of  view  was  mis¬ 
leading.  Often,  in  real  life,  one  begins  with  a  function  /  and  seeks  a 
power  series  that  represents  the  function  for  some  or  all  values  of  x. 
This  is  because  power  series,  being  limits  of  polynomials,  are  in  some 
sense  basic  objects. 

If  we  have  f(x)  =  £21o  anXn  for  |x|  <  R,  then  we  can  differenti¬ 
ate  /  term-by-term  forever.  At  each  step,  we  may  calculate  the  kth 
derivative  of  /  at  0,  written  /W( 0).  It  is  easy  to  show  /(fc)(0)  =  kla^ 
for  k  >  0.  This  tells  us  that  if  f  can  be  represented  by  a  power  series, 
then  that  power  series  must  be  JJkLo  ^~kT^xk-  This  is  the  Taylor  se¬ 
ries  for  /  about  0.  Frequently,  but  not  always,  the  Taylor  series  will 
agree  with  /  on  the  interval  of  convergence.  This  turns  out  to  be 
true  for  many  familiar  functions.  Thus  the  following  relations  can  be 
proved: 


oo 


k= 0 


COSX  = 


E 

k= 0 


1)kx2k, 


(2k) 


sinx  = 


oo 


E 


(~1)A'  2fc+l 

(2k  +  1)! 


for  all  x  in  M.  A  detailed  study  of  Taylor  series  is  given  in  §31. 


Exercises 

26.1  Prove  Theorem  26.4  for  x  >  0. 

26.2  (a)  Observe  22^1=1  nxn  =  (i-x)2  f°r  M  <  T  see  Example  1. 

(b)  Evaluate  22^Li  ff-  Compare  with  Exercise  14.13(d). 

(c)  Evaluate  £^=1  and  £^=1 

26.3  (a)  Use  Exercise  26.2  to  derive  an  explicit  formula  for  222=i  n2xn. 
(b)  Evaluate  £^=1  W  and  E5Ei  fk- 

26.4  (a)  Observe  e~x 2  =  £210  (~V  x2n  f°r  £  £  R,  since  we  have  ex  = 

E~  i  for  ieK. 

(b)  Express  F(x)  =  J*  e  *2  dt  as  a  power  series. 
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26.5  Let  f(x)  =  E^l  o  f°r  x  e  Show  f  =  /.  Do  not  use  the  fact 
that  f(x)  =  ex\  this  is  true  but  has  not  been  established  at  this  point 
in  the  text. 

26.6  Let  s(x)  =  x  —  ^  ^  —  ■  ■  ■  and  c(x)  =  1  —  —  •  •  •  for  x  G  R. 

(a)  Prove  s'  =  c  and  d  =  —  s. 

(b)  Prove  (s2  +  c2)'  =  0. 

(c)  Prove  s2  +  c2  =  1. 

Actually  s(x)  =  sin  a:  and  c(x)  =  cosx ,  but  you  do  not  need  these 
facts. 

26.7  Let  f{x)  =  \x\  for  x  £  R.  Is  there  a  power  series  J ^dnxn  such  that 

f(x )  =  anXn  for  all  xl  Discuss. 

26.8  (a)  Show  E“=o(1),1'x2n  =  for  x  e  (“M)-  Hint ■  T,™=0yn  = 

.  Let  y  =  — x 2. 

l-y  V 

(b)  Show  arctana:  =  E^o  2n+i  x2n+1  f°r  x  6  (—  1,  !)• 

(c)  Show  the  equality  in  (b)  also  holds  for  x  =  1.  Use  this  to  find  a 
nice  formula  for  tt. 

(d)  What  happens  at  x  =  —1? 


§27  *  Weierstrass’s  Approximation  Theorem 

Suppose  a  power  series  has  radius  of  convergence  greater  than  1,  and 
let  /  denote  the  function  given  by  the  power  series.  Theorem  26.1 
tells  us  that  the  partial  sums  of  the  power  series  get  uniformly  close 
to  /  on  [—1,1].  In  other  words,  /  can  be  approximated  uniformly 
on  [—1,1]  by  polynomials.  Weierstrass’s  approximation  theorem  is 
a  generalization  of  this  last  observation,  for  it  tells  us  that  any 
continuous  function  on  [—1, 1]  can  be  uniformly  approximated  by 
polynomials  on  [—1, 1].  This  result  is  quite  different  because  such  a 
function  need  not  be  given  by  a  power  series;  see  Exercise  26.7.  The 
approximation  theorem  is  valid  for  any  closed  interval  [a,  b]  and  can 
be  deduced  easily  from  the  case  [0, 1];  see  Exercise  27.1. 

We  give  the  beautiful  proof  due  to  S.  N.  Bernstein.  Bernstein 
was  motivated  by  probabilistic  considerations,  but  we  will  not  use 
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any  probability  here.  One  of  the  attractive  features  of  Bernstein’s 
proof  is  that  the  approximating  polynomials  will  be  given  explicitly. 
There  are  more  abstract  proofs  in  which  this  is  not  the  case.  On  the 
other  hand,  the  abstract  proofs  lead  to  far-reaching  and  important 
generalizations.  See  the  treatment  in  [31]  or  [62]. 

We  need  some  preliminary  facts  about  polynomials  involving 
binomial  coefficients. 


27.1  Lemma. 

For  every  i£l  and  n  >  0,  we  have 

Proof 

This  is  just  the  binomial  theorem  [Exercise  1.12]  applied  to  a  =  x 
and  b  =  1  —  x,  since  in  this  case  (a  +  b)n  =  ln  =  1.  ■ 


27.2  Lemma. 

For  and  n  >  0,  we  have 

^(ni  —  k)2(r^\xk(l  —  x)n~k  =  nx(  1  —  x)  <  (1) 

fc=o  '  ' 

Proof 

Since  =  n(^T J)  for  k  >  1,  we  have 


k= o 


EM 


-  x)n~k  =  n 


k=  1 
n—  1 

=  nx 

3=0 

=  nx. 

n—2 


n—k 


n  —  1 


x\l  —  x) 


n—l—j 


(2) 


Since  k(k  —  1)(^)  =  n{n  —  1)(^_2)  for  k  >  2,  we  have 


2-2 


E  Hk  ~  1)  (  J  xk(l  -  x)n~k  =  n(n  -  l)z2  ]T 

fc= 0  '  '  j= 0 

=  n(n  —  l)x2. 


n—2 
3 


xj{l-x)n~2-j 

(3) 
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Adding  the  results  in  (2)  and  (3),  we  find 

k 2  f  7f\ xk(l  —  x)n~k  =  n(n  —  1  )x2  +  nx  =  n2x2  +  nx(l  —  x ).  (4) 
fc=o  '  7 

Since  ( nx  —  k )2  =  n2x2  —  2nx-k  +  kr ,  we  use  Lemma  27.1,  (2)  and  (4) 
to  obtain 

V(na;  —  fc)2  ^  ^)xfc(l  —  x)n~k  =  n2x 2  —  2 nx(nx)  +  [n2x2  +  nx(l  —  x)] 
k= 0  '  7 

=  nx(  1  —  x). 

This  establishes  the  equality  in  (1).  The  inequality  in  (1)  simply 
reflects  the  inequality  x(l  —  x)  <  which  is  equivalent  to  4x2  —  4x  + 
1  >  0  or  (2x-  l)2  >  0.  ■ 

27.3  Definition. 

Let  /  be  a  function  defined  on  [0, 1].  The  polynomials  Bnf  defined 
by  ' 

k= 0  v  7  v  7 

are  called  Bernstein  polynomials  for  the  function  /. 

Here  is  Bernstein’s  version  of  the  Weierstrass  approximation 
theorem. 

27.4  Theorem. 

For  every  continuous  function  f  on  [0, 1],  we  have 
Bnf  — >  f  uniformly  on  [0, 1]. 


Proof 

We  assume  /  is  not  identically  zero,  and  we  let 
M  =  sup{|/(x)|  :  x  G  [0, 1]}. 

Consider  e  >  0.  Since  /  is  uniformly  continuous  by  Theorem  19.2, 
there  exists  <5  >  0  such  that 

x,y€[ 0,1]  and  \x  -  y\  <  5  imply  |/(x)  -  f(y)\  <  (1) 
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Let  N  =  Alj.  This  choice  of  N  is  unmotivated  at  this  point,  but  we 
make  it  here  to  emphasize  that  it  does  not  depend  on  the  choice  of  x. 
We  will  show 

\Bnf(x)  —  f(x)  |  <  e  for  all  x  £  [0, 1]  and  all  n  >  N,  (2) 

completing  the  proof  of  the  theorem. 

To  prove  (2),  consider  a  fixed  x  £  [0, 1]  and  n  >  N.  In  view  of 
Lemma  27.1,  we  have 


k= 0  '  ' 


SO 


\Bnf(x)  ~  f(x)  |  < 


k= 0 


/(^]-/W 


xk(l  —  X ) 


n—k 


(3) 


To  estimate  this  sum,  we  divide  the  set  {0, 1,2, ...  ,n}  into  two  sets: 

>  S. 

n 

For  k  £  A  we  have  |/(^)  —  f(x) |  <  |  by  (1),  so 


7:  £  71  if 

k 

- X 

<  8  while  k  £  B  if 

k 

- X 

n 

n 

E 

keA 


f  (  \  )  -  /(*) 


n 


xk(\-x) 


n—k 


sE 

k£A 


e  n 

2  U 


xk(l-x)n~k  <  | 


(4) 


using  Lemma  27.1.  For  k  (z  B,  we  have 
n252,  so 


I  k—nx | 


>  5  or  (k  —  nx)2  > 


E 

keB 


f  (  ^  )  -  /(*) 


k&B 

By  Lemma  27.2,  this  is  bounded  by 
2  M  n 


\xk(l-x)n~k  <2  MV  -x)n-fc 


M  M 
< 


n262  4  2n<52  21Y<52 
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This  observation,  (4)  and  (3)  show 

l-Bn/0)  -  f(x) |  <  e. 

That  is,  (2)  holds.  ■ 

27.5  Weierstrass’s  Approximation  Theorem. 

Every  continuous  function  on  a  closed  interval  [a,  b]  can  be  uniformly 
approximated  by  polynomials  on  [a,  b] . 

In  other  words,  given  a  continuous  function  /  on  [a,  b],  there  exists 
a  sequence  (pn)  of  polynomials  such  that  pn  — >  /  uniformly  on  [a,b], 

27.6  Corollary. 

Given  a  continuous  function  f  on  [a,b],  there  exists  a  sequence  (pn) 
of  polynomials  such  that  pn  — »  /  uniformly  on  [a,b\,  and  for  each  n, 
pn(a)  =  f (a)  andpn(b)  =  f(b). 

Proof 

See  Exercise  27.4.  ■ 


Exercises 

27.1  Prove  Theorem  27.5  from  Theorem  27.4.  Hint:  Let  f(x)  =  (b—a)x+a 
so  that  f  maps  [0, 1]  onto  [o,  b].  If  /  is  continuous  on  [a,  6],  then  f  of 
is  continuous  on  [0, 1]. 

27.2  Show  that  if  /  is  continuous  on  R,  then  there  exists  a  sequence  ( pn ) 
of  polynomials  such  that  pn  — >  /  uniformly  on  each  bounded  subset 
of  R.  Hint:  Arrange  for  |  f(x)  —  pn(x) \  <  -  for  \x\  <  n. 

27.3  Show  there  does  not  exist  a  sequence  of  polynomials  converging 
uniformly  on  R  to  /  if 

(a)  f(x)  =  sinx,  (b)  f(x)  =  ex. 

27.4  Prove  Corollary  27.6.  Hint:  Select  a  sequence  ( qn )  of  polynomials  such 
that  qn  >  f  uniformly  on  [a,  b\.  For  each  n,  let  sn  be  the  function 
on  R  whose  graph  is  the  straight  line  passing  through  the  points 
(a,  /(a)  -  q„(a))  and  (6,  f(b)  -  qn(b)).  Set  pn  =  qn  +  sn. 

27.5  Find  the  sequence  ( Bnf )  of  Bernstein  polynomials  in  case 

(a)  f(x)  =  x,  (b)  f(x)  =  x2. 
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27.6  The  Bernstein  polynomials  were  defined  for  any  function  /  on  [0, 1]. 
Show  that  if  Bnf  — >  /  uniformly  on  [0,1],  then  /  is  continuous 
on  [0, 1]. 

27.7  Let  /  be  a  bounded  function  on  [0, 1],  say  |/(ar)|  <  M  for  all  x  £  [0, 1]. 
Show  that  all  the  Bernstein  polynomials  Bnf  are  bounded  by  M. 
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CHAPTER 


In  this  chapter  we  give  a  theoretical  treatment  of  differentiation  and 
related  concepts,  most  or  all  of  which  will  be  familiar  from  the  stan¬ 
dard  calculus  course.  Three  of  the  most  useful  results  are  the  Mean 
Value  Theorem  which  is  treated  in  §29,  L’Hospital’s  Rule  which  is 
treated  in  §30,  and  Taylor’s  Theorem  which  is  given  in  §31. 


§28  Basic  Properties  of  the  Derivative 

The  reader  may  wish  to  review  the  theory  of  limits  treated  in  §20. 


28.1  Definition. 

Let  /  be  a  real- valued  function  defined  on  an  open  interval  containing 
a  point  a.  We  say  /  is  differentiable  at  a,  or  f  has  a  derivative  at  a, 
if  the  limit 


lim 

x^f-a 


f(x)  -  f(a) 
x  —  a 
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exists  and  is  finite.  We  will  write  f'(a)  for  the  derivative  of  /  at  a: 


/'(«) 


lint 

x^a 


f(x)  -  f{a ) 
x  —  a 


(1) 


whenever  this  limit  exists  and  is  finite. 


Generally  speaking,  we  will  be  interested  in  f  as  a  function  in 
its  own  right.  The  domain  of  f  is  the  set  of  points  at  which  /  is 
differentiable;  thus  dom(/')  C  dom(/). 


Example  1 

The  derivative  of  the  function  g(x)  =  x2  at  x  =  2  was  calculated  in 
Example  2  of  §20: 

x2  —  4 

g'( 2)  =  lim  -  =  limfa;  +  2)  =  4. 

x — >2  X  2  x — >2 

We  can  calculate  g'(a )  just  as  easily: 

X2  —  CL2 

g'{a)  =  lim - =  lim  (x  +  a)  =  2a. 

2— Hi  x  —  a  2— Hi 


This  computation  is  even  valid  for  a  =  0.  We  may  write  g'{x)  =  2x 
since  the  name  of  the  variable  a  or  x  is  immaterial.  Thus  the  deriva¬ 
tive  of  the  function  given  by  g(x)  =  x2  is  the  function  given  by 
g'{x)  =  2x,  as  every  calculus  student  knows.  □ 


Example  2 

The  derivative  of  h(x)  =  yjx  at  x  - 
of  §20:  h'(  1)  =  In  fact,  h(x)  =  x 
for  x  >  0;  see  Exercise  28.3. 


=  1  was  calculated  in  Example  3 
l,/2  for  x  >  0  and  h'(x)  =  \x~x^2 

□ 


Example  3 

Let  n  be  a  positive  integer,  and  let  f{x)  =  xn  for  all  We  show 

f'{x)  =  nxn~l  for  all  Fix  a  in  M  and  observe 

j(x)  —  j{a)  =  x  —a  =  (x— a)(x  +ax  +a  x  +■■■-! -a  x+a  ), 


SO 


f{x)  -  f{a) 


=  X 


n—  1 


axn~2  +  a2xn~3  +  •  •  •  +  an~2x  +  a’1"1 


x  —  a 
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for  i^a,  It  follows  that 
f(x)  -  f(a) 


f\a )  =  lirn 


=  a 


x^a 
n—  1 


x  —  a 

+  aan~2  +  aV"3  + 


+  an~2a  +  an_1  =  nan~l\ 


we  are  using  Theorem  20.4  and  the  fact  that  limx^a  xk  =  ak  for  k 
in  N.  □ 

We  first  prove  differentiability  at  a  point  implies  continuity  at 
the  point.  This  may  seem  obvious  from  all  the  pictures  of  familiar 
differentiable  functions.  However,  Exercise  28.8  contains  an  example 
of  a  function  that  is  differentiable  at  0  and  of  course  continuous  at 
0  [by  the  next  theorem],  but  is  discontinuous  at  all  other  points. 

28.2  Theorem. 

If  f  is  differentiable  at  a  point  a,  then  f  is  continuous  at  a. 

Proof 

We  are  given  f'(a)  =  limx^.a  ,  and  we  need  to  prove 

li mx^af(x)  =  f  (a).  We  have 

fix)  =  (x-  a) - b  /(a) 

x  —  a 

for  x  £  dom(/),  x  ^  a.  Since  limx^.a (x  —  a)  =  0  and  limx_>.a 
exists  and  is  finite,  Theorem  20.4(h)  shows  limx^a (x  —  a)- 
/(H-Zd')  _  q  Therefore  lim X^.af(x)  =  /(a),  as  desired.  ■ 


We  next  prove  some  results  about  sums,  products,  etc.  of  deriva¬ 
tives.  Let  us  first  recall  why  the  product  rule  is  not  ( fg )'  =  f'g' 
[as  many  naive  calculus  students  wish!]  even  though  the  product  of 
limits  does  behave  as  expected: 


lim(/i/2)(x)  =  lim  fi(x) 

x^a  L  x^a 


lim  f2{x ) 


provided  the  limits  on  the  right  side  exist  and  are  finite;  see  Theo¬ 
rem  20.4(h).  The  difficulty  is  that  the  limit  for  the  derivative  of  the 
product  is  not  the  product  of  the  limits  of  the  derivatives,  i.e., 

f{x)g{x)  -  f{a)g(a )  ^  f{x)  -  /(a)  _  g{x)  -  g{a) 


x  —  a 


x  —  a 


x  —  a 
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The  correct  product  rule  is  obtained  by  shrewdly  writing  the  left 
hand  side  in  terms  of  and  as  hi  the  proof  of 

Theorem  28.3(iii)  below. 


28.3  Theorem. 

Let  f  and  g  be  functions  that  are  differentiable  at  the  point  a.  Each  of 
the  functions  cf  [c  a  constant ],  f+g,  fg  and  f  / g  is  also  differentiable 
at  a,  except  f  / g  if  g{a)  =  0  since  f  / g  is  not  defined  at  a  in  this  case. 
The  formulas  are 

(i)  (cf)'  (a)  =  c  ■  f(a); 

(ii)  (/  +  S)'(a)  =  /'(a)  +  s'(a)\ 

(iii)  [ product  rule ]  (fg)'{a)  =  f(a)g'  (a)  +  f'(a)g(a ); 

(iv)  [ quotient  rule ]  ( f/g)'(a )  =  [g(a)f'(a)  -  f(a)g'(a)\/g2(a )  if 

g(a)  +  o. 


Proof 

(i)  By  definition  of  cf  we  have  (c/)(x)  =  c  •  f(x)  for  all  x  € 
dom(/);  hence 

,  tV,  ^  v  (c/)(x)  -  (c/)(a)  f(x)  —  f(a)  , 

(cf)  (a)  =  Inn -  =  lim  c - =  c-f  (a). 

x^>a  X  —  a  x—ta  x  —  a 

(ii)  This  follows  from  the  identity 

(f  +  g)(x)  ~  (/  +  g)(a)  =  f(x)  -  f(a)  +  g(x)  -  g(a) 


x  —  a 


x  —  a 


x  —  a 


upon  taking  the  limit  as  x  — >  a  and  applying  Theorem  20.4(i). 
(iii)  Observe 

(/fl)(s)  -  =  j^g(x)-g(a)  ,  g^f(x)  ~  f(a) 


x  —  a 


x  —  a 


x  —  a 


for  x  E  dom(/g),  We  take  the  limit  asi-ta  and  note 

that  lim X_>af(x)  =  f(a)  by  Theorem  28.2.  We  obtain  [again 
using  Theorem  20.4] 

(fg)'(a)  =  f(a)g'(a)+g(a)f'(a). 

(iv)  Since  g(a)  0  and  g  is  continuous  at  a,  there  exists  an  open 
interval  I  containing  a  such  that  g(x)  0  for  x  E  I.  For  i£l 
we  can  write 


§28.  Basic  Properties  of  the  Derivative  227 


if/g)(x)  -  ( f/g)(a ) 


fjx)  _  ffaf  =  g{a)f{x)  -  f(a)g(x) 
g(x)  g(a)  g(x)g(a) 

g(a)f(x)  -  g(a)f(a)  +  ff  (a)/(a)  -  fja)g(x) 
g{x)g{a) 


SO 


(f/g)(x)  -  ( f/g)(a ) 


x  —  a 


=  \  9{a) 


fix)  -  /(a) 


x  —  a 


~  /(«) 


3(x)  -  5(a) 


x  —  a 


1 


g{x)g{a ) 


for  x  E  I,  x  7^  a.  Now  we  take  the  limit  as  i  -i  a  to  obtain 
(iv);  note  that  limx^Q  ■ 


Example  4 

Let  m  be  a  positive  integer,  and  let  h(x)  =  x~m  for  i  ^  0,  Then 
h(x)  =  f(x)/g(x)  where  f(x)  =  1  and  g(x)  =  xm  for  all  x.  By  the 
quotient  rule, 


,  ,,  \  g{a)f'(a )  ~  f(a)g'{a )  am  ■  0  -  1  •  mod 

h  a)  =  - 2 T~\ - = - 2^ - 

g  (a)  aAm 


=  -ma 


a 


m+ 1 


for  a  7^  0.  If  we  write  n  for  —to,  then  we  see  the  derivative  of  xn 
is  nxn~l  for  negative  integers  n  as  well  as  for  positive  integers.  The 
result  is  also  trivially  valid  for  n  =  0.  For  fractional  exponents,  see 
Exercise  29.15.  □ 


28.4  Theorem  [Chain  Rule]. 

If  f  is  differentiable  at  a  and  g  is  differentiable  at  f(a),  then  the 
composite  function  go  f  is  differentiable  at  a  and  we  have  (gof)'(a)  = 
g'(f(a))-f(a). 

Discussion.  Here  is  a  faulty  “proof”  which  nevertheless  contains 
the  essence  of  a  valid  proof.  We  write 

g°  fix)  -go  f (a)  =  gjfjx))  -  gjfja ))  _  fix)  -  f{a ) 

fix)  -  /(a) 


x  —  a 


x  —  a 


(1) 
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for  x  7^  a.  Since  limx_>.a  f(x)  =  /(a),  we  have 

,•  g(/0*0)  -  g{f(a))  =  ..  g(y)-g(f(a )) 

^  f(x)-f(a)  *-►/(«)  y  —  f  (a) 


g'{f{a))- 


(2) 


We  also  have  limx_s.a  =  /'(a),  so  (1)  shows  ( g  o  f)'(a)  = 

g'(f{a))  ■  f(a). 

The  main  problem  with  this  “proof”  is  that  f{x)  —  f{a)  in  Eq.  (2) 
might  be  0  for  x  arbitrarily  close  to  a.  If,  however,  f(x)  ^  f{a )  for 
x  near  a,  then  this  proof  can  be  made  rigorous.  If  f(x)  =  f(a)  for 
some  x’s  near  a,  the  “proof”  cannot  be  repaired  using  (2).  In  fact, 
Exercise  28.5  gives  an  example  of  differentiable  functions  /  and  g  for 
which  limx_>.o  is  meaningless. 

We  now  give  a  rigorous  proof,  but  we  will  use  the  sequential 
definition  of  a  limit.  The  proof  reflects  ideas  in  the  article  by  Stephen 
Kenton  [36]. 


Proof 

The  hypotheses  include  the  assumptions  that  /  is  defined  on  an 
open  interval  J  containing  a,  and  g  is  defined  on  an  open  interval 
I  containing  /(a).  It  is  easy  to  check  g  o  f  is  defined  on  some  open 
interval  containing  a  (see  Exercise  28.13),  so  by  taking  J  smaller  if 
necessary,  we  may  assume  g  o  f  is  defined  on  J. 

By  Definitions  20.3(a)  and  20.1,  it  suffices  to  consider  a  sequence 
(xn)  in  J  \  {a}  where  limn  xn  =  a  and  show 

,.  g°  f(xn)  ~  go  f(a)  (  , 

Inn  - =  g  (/(a))  •  /  (a).  (3) 

n—Hxi  xn  —  a 

For  each  n,  let  yn  =  f(xn).  Since  /  is  continuous  at  x  =  a,  we  have 
lim nyn  =  f(a).  For  f(xn)  ^  f(a), 

{g°  f){xn)  -  {g°  /)(«)  =  g{yn)  -  g(/(«))  _  f(xn)  -  f(a ) 

Xn  -  a  yn  -  f  (a)  xn  -  a 

Case  1.  Suppose  f(x)  ^  f(a )  for  x  near  a.  Then  yn  =  f(xn )  ^ 

f(a )  for  large  n,  so  taking  the  limit  in  (4),  as  n  — >  oo,  we  obtain 

{g°  f)'(a)  =  g'{f{a ))  •  /'(a). 
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Case  2.  Suppose  f(x)  =  f(a )  for  x  arbitrarily  close  to  a.  Then 
there  is  a  sequence  (zn)  in  J\  {a}  such  that  limn  zn  =  a  and  f(zn )  = 
/(a)  for  all  n.  Then 


/'(a)  =  lim  /fa)  ~  Ha)  =  lim  -°- 
n->  oo  Zn  —  a  n-y  oo  zn  —  a 

and  it  suffices  to  show  (g  o  f)'(a)  =  0.  We  do  have 


=  0, 


lim  9(/("">)  ~  g(/(°»  =  lim  =  0, 

n—Hx>  Zn  —  a  n—Hx  zn  —  a 

but  this  only  assures  us  that  (g  o  f)'(a )  =  0  provided  we  know  this 

derivative  exists.  To  help  us  prove  this,  we  note  g'(f(a))  exists  and 

so  the  difference  quotients  are  bounded  near  f(a).  Thus, 

replacing  the  open  interval  I  by  a  smaller  one  if  necessary,  there  is 

a  constant  C  >  0  so  that 


g(y)-g(f(a )) 


y  -  /(a) 


<C  for  ye/\/(a). 


Therefore 


(g°  f)(xn)  -  (go  f)(a) 

<  c 

3 

1 

% n  & 

Xn  CL 

for  large  n,  (5) 


which  is  clear  if  f(xn )  =  /(a)  and  otherwise  follows  from  Eq.  (4). 
Since  f'(a )  =  0,  the  right  side  of  (5)  tends  to  0  as  n  -*  oo;  thus 
the  left  side  also  tends  to  0.  Since  (xn)  is  any  sequence  in  J  \  {a} 
converging  to  a,  we  conclude  ( g  o  f)'{a )  =  0,  as  desired.  ■ 


It  is  worth  emphasizing  that  if  /  is  differentiable  on  an  interval  I 
and  if  g  is  differentiable  on  {f(x)  :  x  6  I},  then  (g  o  /)'  is  exactly 
the  function  ( g '  o  f)  •  f  on  /. 


Example  5 

Let  h(x)  =  sin(x3  +  7x)  for  x  6  K.  The  reader  can  undoubtedly 
verify  h'(x)  =  (3x2  +  7)  cos(x3  +  7x)  for  x  £  M  using  some  automatic 
technique  learned  in  calculus.  Whatever  the  automatic  technique,  it 
is  justified  by  the  chain  rule.  In  this  case,  h  =  g  o  f  where  f(x)  = 
x3  +  7x  and  g(y)  =  siny.  Then  f'(x)  =  3x2  +  7  and  g'(y )  =  cos  y  so 
that 

h'{x)  =  g'(f(x))  ■  f'(x)  =  [cos  f(x)]  ■  f'(x)  =  [cos(x3  +  7x)\  ■  (3x2  +  7). 
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We  do  not  want  the  reader  to  unlearn  the  automatic  technique,  but 
the  reader  should  be  aware  that  the  chain  rule  stands  behind  it.  □ 


Exercises 

28.1  For  each  of  the  following  functions  defined  on  R,  give  the  set  of 
points  at  which  it  is  not  differentiable.  Sketches  will  be  helpful. 

(a)  (b)  sin  |x| 

(c)  |  sin  a: |  (d)  |x|  +  \x  —  1| 

(e)  |a:2-l|  (f)  |x3-8| 

28.2  Use  the  definition  of  derivative  to  calculate  the  derivatives  of  the 
following  functions  at  the  indicated  points. 

(a)  f{x)  =  x3  at  x  =  2; 

(b)  g{x)  =  x  +  2  at  x  =  a; 

(c)  f(x)  =  x2  cosx  at  x  =  0; 

(d)  r(x)  =  at  x  =  1. 

28.3  (a)  Let  h{x)  =  yfx  =  a;1/2  for  x  >  0.  Use  the  definition  of  derivative 

to  prove  h'(x)  =  \x^x!2  for  x  >  0. 

(b)  Let  fix)  =  x 1/3  for  x  £  R  and  use  the  definition  of  derivative 
to  prove  f{x)  =  \x~2^3  for  i/0. 

(c)  Is  the  function  /  in  part  (b)  differentiable  at  x  =  0?  Explain. 

28.4  Let  f(x)  =  x2  sin  ^  for  x  f  0  and  /( 0)  =  0. 

(a)  Use  Theorems  28.3  and  28.4  to  show  /  is  differentiable  at  each 
a  f  0  and  calculate  f(a).  Use,  without  proof,  the  fact  that 
sin  a:  is  differentiable  and  that  cos  a;  is  its  derivative. 

(b)  Use  the  definition  to  show  f  is  differentiable  at  x  =  0  and 

f(0)  =  o. 

(c)  Show  /'  is  not  continuous  at  x  =  0. 

28.5  Let  f{x)  =  x2  sin  ^  for  x  f  0,  /( 0)  =  0,  and  gix)  =  x  for  x  €  R. 

(a)  Observe  /  and  g  are  differentiable  on  R. 

(b)  Calculate  fix)  for  x  =  n  =  ±1,  ±2, . . .. 

(c)  Explain  why  lim^^o  /(o)0^  meaningless. 
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28.6  Let  f(x)  =  xsin  ~  for  x  7^  0  and  /( 0)  =  0.  See  Fig.  19.3. 

(a)  Observe  /  is  continuous  at  x  =  0  by  Exercise  17.9(c). 

(b)  Is  /  differentiable  at  x  =  0?  Justify  your  answer. 

28.7  Let  f(x)  =  x2  for  x  >  0  and  f(x)  =  0  for  x  <  0. 

(a)  Sketch  the  graph  of  /. 

(b)  Show  /  is  differentiable  at  x  =  0.  Hint :  You  will  have  to  use 
the  definition  of  derivative. 

(c)  Calculate  /'  on  R  and  sketch  its  graph. 

(d)  Is  /'  continuous  on  R?  differentiable  on  R? 

28.8  Let  f(x)  =  x2  for  x  rational  and  f(x)  =  0  for  x  irrational. 

(a)  Prove  /  is  continuous  at  x  =  0. 

(b)  Prove  /  is  discontinuous  at  all  i/O. 

(c)  Prove  /  is  differentiable  at  x  =  0.  Warning :  You  cannot  simply 
claim  f'(x)  =  2x. 

28.9  Let  h{x)  =  (x4  +  13a;)7. 

(a)  Calculate  h'(x). 

(b)  Show  how  the  chain  rule  justifies  your  computation  in  part  (a) 
by  writing  h  =  g  o  f  for  suitable  /  and  g. 

28.10  Repeat  Exercise  28.9  for  the  function  h(x)  =  (cos  a;  +  ex)12. 

28.11  Suppose  /  is  differentiable  at  a,  g  is  differentiable  at  /(a),  and  h  is 
differentiable  at  g  o  f(a).  State  and  prove  the  chain  rule  for  (ho  g  o 
f)'(a).  Hint :  Apply  Theorem  28.4  twice. 

28.12  (a)  Differentiate  the  function  whose  value  at  x  is  cos(e3;B~3a:). 

(b)  Use  Exercise  28.11  or  Theorem  28.4  to  justify  your  computation 
in  part  (a). 

28.13  Show  that  if  /  is  defined  on  an  open  interval  containing  a,  if  g  is 
defined  on  an  open  interval  containing  /(a),  and  if  /  is  continuous 
at  a,  then  g  o  f  is  defined  on  an  open  interval  containing  a. 

28.14  Suppose  f  is  differentiable  at  a.  Prove 

(a)  lim^o  /(a+^/(a)  =  /»,  (b)  lim^o  ^+h^a~^  =  f'(a). 
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28.15  Prove  Leibniz’  rule 

k—0  '  ' 

provided  both  /  and  g  have  n  derivatives  at  a.  Here  signifies 
the  jth  derivative  of  h  so  that  =  h,  /i^1)  =  h! ,  h ^  =  h" ,  etc. 
Also,  is  the  binomial  coefhcient  that  appears  in  the  binomial 
expansion;  see  Exercise  1.12.  Hint-.  Use  mathematical  induction.  For 
n  =  l,  apply  Theorem  28.3(iii). 

28.16  Let  /  be  a  function  defined  on  an  open  interval  I  containing  a.  Show 
f(a)  exists  if  and  only  if  there  is  a  function  e(x)  defined  on  /  such 
that 


/( x)  —  f(a )  =  (x  —  a)[f(a)  —  e(x)]  and  lim  e(x)  =  0. 

x  — Ya 
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Our  first  result  justifies  the  following  strategy  in  calculus:  To  find  the 
maximum  and  minimum  of  a  continuous  function  /  on  an  interval 
[a,  b]  it  suffices  to  consider  (a)  the  points  x  where  f(x)  =  0;  (b)  the 
points  where  /  is  not  differentiable;  and  (c)  the  endpoints  a  and  b. 
These  are  the  candidates  for  maxima  and  minima. 


29.1  Theorem. 

If  f  is  defined  on  an  open  interval  containing  xq,  if  f  assumes  its 
maximum  or  minimum  at  xq,  and  if  f  is  differentiable  at  xq,  then 
f(x  o)  =  0. 


Proof 

We  suppose  /  is  defined  on  (a,  b)  where  a  <  xq  <  b.  Since  either  / 
or  —  /  assumes  its  maximum  at  xq,  we  may  assume  /  assumes  its 
maximum  at  xq. 

Assume  first  that  f{x o)  >  0.  Since 


/'  Oo) 


lim 

X^-XQ 


f(x)  -  f(x0) 


X  —  Xq 
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there  exists  (5  >  0  such  that  a  <  xq  —  8  <  xq  +  5  <  b  and 

0  <  \x  —  xo|  <  5  implies  ^  ^ ^  >  0;  (1) 

x  —  Xo 

see  Corollary  20.7.  If  we  select  x  so  that  xq  <  x  <  xq  +  <5,  then  (1) 
shows  f(x)  >  f(x o),  contrary  to  the  assumption  that  /  assumes  its 
maximum  at  xo ■  Likewise,  if  f'(x o)  <  0,  there  exists  <5  >  0  such  that 

0  <  \x  —  xq\  <  5  implies  - f(xo)  <  g  (2) 

x  —  Xo 

If  we  select  x  so  that  xq  —  5  <  x  <  xq,  then  (2)  implies  f(x)  >  f(x o), 
again  a  contradiction.  Thus  we  have  f'(x o)  =  0.  ■ 

Our  next  result  is  fairly  obvious  except  for  one  subtle  point:  one 
needs  to  know  or  believe  that  a  continuous  function  on  a  closed 
interval  assumes  its  maximum  and  minimum.  We  proved  this  in 
Theorem  18.1  using  the  Bolzano- Weierstrass  theorem. 

29.2  Rolle’s  Theorem. 

Let  f  be  a  continuous  function  on  [a,  b]  that  is  differentiable  on  (a,  b ) 
and  satisfies  f(a)  =  f(b).  There  exists  [at  least  one }  x  in  ( a,  6 )  such 
that  f(x)  =  0. 

Proof 

By  Theorem  18.1,  there  exist  xo,yo  £  [a,  6]  such  that  f(x o)  <  f(x)  < 
/(yo)  f°r  all  x  £  [a,  b\.  If  xq  and  yo  are  both  endpoints  of  [a,  b\,  then 
/  is  a  constant  function  [since  /(a)  =  /(&)]  and  f(x )  =  0  for  all 
x  £  (a,  b).  Otherwise,  /  assumes  either  a  maximum  or  a  minimum 
at  a  point  x  in  (a,  6),  in  which  case  f'(x)  =  0  by  Theorem  29.1.  ■ 

The  Mean  Value  Theorem  tells  us  that  a  differentiable  function 
on  [a,  b]  must  somewhere  have  its  derivative  equal  to  the  slope  of  the 
line  connecting  (a,  /(a))  to  (6,  /(b)),  namely  •  See  Fig.  29.1. 

29.3  Mean  Value  Theorem. 

Let  f  be  a  continuous  function  on  [a,  b ]  that  is  differentiable  on  (a,  b ). 
Then  there  exists  [at  least  one]  x  in  (a,  b)  such  that 
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{bjm 


b 


FIGURE  29.1 


/'(*) 


f{b)  -  f  (a) 
b  —  a 


(1) 


Note  that  Rolle’s  Theorem  is  the  special  case  of  the  Mean  Value 
Theorem  where  /(a)  =  /(&). 


Proof 

Let  L  be  the  function  whose  graph  is  the  straight  line  connect¬ 
ing  (a, /(a))  to  (b,f(b)),  i.e.,  the  dotted  line  in  Fig.  29.1.  Observe 
L(a)  =  /(a),  L(b)  =  f(b)  and  L'(x)  =  for  all  x.  Let 

g(x)  =  f(x)  —  L(x)  for  x  E  [a,  b\.  Clearly  g  is  continuous  on  [a,b\ 
and  differentiable  on  (a,  b).  Also  g(a)  =  0  =  g(b),  so  g\x)  =  0 
for  some  x  E  (a,b)  by  Rolle’s  Theorem  29.2.  For  this  x,  we  have 
/'(*)  =  L\x)  =  • 


29.4  Corollary. 

Let  f  be  a  differentiable  function  on  (a,  b )  such  that  f(x)  =  0  for  all 
x  E  (a,  b).  Then  f  is  a  constant  function  on  ( a,b ). 


Proof 

If  /  is  not  constant  on  (a,  b),  then  there  exist  x\,x%  such  that 


a  <  x\  <  X2  <  b  and  f(x i)  7^  /{xf)- 

By  the  Mean  Value  Theorem,  for  some  x  E  {x\,xf)  we  have  f(x)  = 
/(z2)-/0i)  ^  0,  a  contradiction.  ■ 


X2—X1 
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29.5  Corollary. 

Let  f  and  g  be  differentiable  functions  on  (a,  b )  such  that  f  =  g'  on 
( a,b ).  Then  there  exists  a  constant  c  such  that  f(x)  =  g(x)  +  c  for 
all  x  G  (a,  b). 

Proof 

Apply  Corollary  29.4  to  the  function  f  —  g.  ■ 

Corollary  29.5  is  important  for  integral  calculus  because  it  guar¬ 
antees  all  antiderivatives,  alias  indefinite  integrals,  for  a  function 
differ  by  a  constant.  Old  integral  tables  and  modern  computational 
software  programs  provide  formulas  like 

J  x2  cos  xdx  =  2x  cos  x  +  (x2  —  2)  sin  x  +  C. 

It  is  straightforward  to  show  the  derivative  of  each  function  2x  cosx+ 
(. x 2  —  2)  sins  +  C  is  in  fact  x2  cosx.  Corollary  29.5  shows  that  these 
are  the  only  antiderivatives  of  x2  cos  x. 

We  need  some  terminology  in  order  to  give  another  useful 
corollary  of  the  Mean  Value  Theorem. 

29.6  Definition. 

Let  /  be  a  real-valued  function  defined  on  an  interval  I.  We  say  /  is 
strictly  increasing  on  I  if 


X\,X2  G  I 

and 

X\  <  X2 

imply 

f(x l)  <  f(x 2) 

strictly  decreasing 

on  I  if 

Xi,X2  G  I 

and 

X\  <  X2 

imply 

f(x  1)  >  f(x 2) 

increasing  on  I  if 

Xi,X2  G  I 

and 

X\  <  X2 

imply 

f(x  1)  <  f(x2) 

and  decreasing  on 

/  if 

xi,x2  G  I 

and 

X\  <  X2 

imply 

f(x  1)  >  f(x 2) 

Example  1 

The  functions  ex  on  M  and  yfx  on  [0,  oo)  are  strictly  increasing.  The 
function  coss  is  strictly  decreasing  on  [0,7r].  The  signurn  function 
and  the  postage-stamp  function  in  Exercises  17.10  and  17.16  are 
increasing  functions  but  not  strictly  increasing  functions.  □ 
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29.7  Corollary. 

Let  f  be  a  differentiable  function  on  an  interval  ( a,b ).  Then 

(i)  f  is  strictly  increasing  if  f'(x)  >  0  for  all  x  E  (a,  6); 

(ii)  f  is  strictly  decreasing  if  f'(x)  <  0  for  all  x  E  (a,  6); 

(iii)  /  is  increasing  if  f'(x)  >  0  /or  all  x  E  (a,  6); 

(iv)  /  is  decreasing  if  f'{x )  <  0  /or  all  x  E  (a,  b). 


Proof 

(i)  Consider  xi ,  x2  where  a  <  xi  <  x2  <  b.  By  the  Mean  Value 
Theorem,  for  some  x  E  (xi,x2)  we  have 


/(x2)  -  f{x l) 

X2  -  Xl 


f'{x)  >  0. 


Since  x2  —  xi  >  0,  we  see  /(x2)  —  /(xi)  >  0  or  /(x2)  >  f(x i). 
The  remaining  cases  are  left  to  Exercise  29.8.  ■ 


Exercise  28.4  shows  the  derivative  f  of  a  differentiable  function 
/  need  not  be  continuous.  Nevertheless,  like  a  continuous  function, 
f  has  the  intermediate  value  property  [see  Theorem  18.2]. 


29.8  Intermediate  Value  Theorem  for  Derivatives. 

Let  f  be  a  differentiable  function  on  (a,b).  If  a  <  x\  <  x2  <  b,  and 
if  c  lies  between  f'{xf)  and  f'{x 2),  there  exists  [at  least  one]  x  in 
(xi,x2)  such  that  f'{x )  =  c. 


Proof 

We  may  assume  f'(x i)  <  c  <  f'(x 2).  Let  g(x)  =  f(x)  —  cx  for 
x  E  (a,  b).  Then  we  have  g'{x i)  <  0  <  <7,(.t2).  Theorem  18.1  shows  g 
assumes  its  minimum  on  [xi,x2]  at  some  point  xq  E  [xi,x2].  Since 


9'(zi) 


lim 

y^rx\ 


g{y)  -  g(x  1) 
y  -  xi 


<o, 


g(y)—g(xi)  is  negative  for  y  close  to  and  larger  than  x\.  In  particular, 
there  exists  y \  in  (xi,x2)  such  that  g{yf)  <  g{x i).  Therefore  g  does 
not  take  its  minimum  at  x\ ,  so  we  have  xq  x\.  Similarly,  there 
exists  2/2  in  (xi,x2)  such  that  g(y2)  <  g(x2),  so  xo  7^  x2.  We  have 
shown  xo  is  in  (xi,x2),  so  g'(x 0)  =  0  by  Theorem  29.1.  Therefore 
/'(^o)  =  s'^o)  +  c  =  c.  ■ 
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We  next  show  how  to  differentiate  the  inverse  of  a  differentiable 
function.  Let  /  be  a  one-to-one  differentiable  function  on  an  open 
interval  I.  By  Theorem  18.6,  /  is  strictly  increasing  or  strictly  de¬ 
creasing  on  I,  and  by  Corollary  18.3  the  image  f(I)  is  an  interval  J. 
The  set  J  is  the  domain  of  /_1  and 

f~lof(x)=x  for  x<El;  fof~1(y)  =  y  for  y  €  J. 

The  formula  for  the  derivative  of  /_1  is  easy  to  obtain  [or  remember] 
from  the  Chain  Rule:  x  =  /_1  o  /(x),  so 

1  =  (/_1)'(/<»)  •  f'(x)  for  all  x(E  I. 


If  xq  6  I  and  yo  =  f(x o),  then  we  can  write  1  =  (/  1),(yo)  ■  f{x o)  or 


(f-ycvo) 


i 

f'(xo) 


where  y0  =  f(x  0). 


This  is  not  a  proof  because  the  Chain  Rule  requires  the  functions,  f~3 
and  /  in  this  case,  be  differentiable.  We  assumed  /  is  differentiable, 
but  we  must  prove  /_1  is  also  differentiable.  In  addition,  observe 
f(x o)  might  be  0  [consider  /(x)  =  x3  at  xq  =  0],  so  our  final  result 
will  have  to  avoid  this  possibility. 


29.9  Theorem. 

Let  f  be  a  one-to-one  continuous  function  on  an  open  interval  I,  and 
let  J  =  /(/).  If  f  is  differentiable  at  xo  G  I  and  if  f'(x o)  7^  0,  then 
/-1  is  differentiable  at  yo  =  f{x 0)  and 


(/_1)'(y 0) 


1 

/'(*  0)’ 


Proof 

Note  that  J  is  also  an  open  interval.  We  have  lim-j,-^  = 

f(x 0).  Since  f  [x 0)  7^  0  and  since  f[x)  7^  f(x 0)  for  x  near  xo,  we 
can  write 


x-xp  _  1 

/(x)  -  /(x0)  f(x 0)’ 


(1) 


see  Theorem  20.4(iii).  Let  e  >  0.  By  (1)  and  Corollary  20.7,  there 
exists  6  >  0  such  that 


x  —  Xo  1 

/(x)  -  /(x0)  /'(x0) 


0  <  |x  —  xq|  <  d  implies 


<  e.  (2) 
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Let  g  =  /-1  and  observe  that  g  is  continuous  at  yo  by  Theorems  18.6 
and  18.4  [or  Exercise  18.11].  Hence  there  exists  g  >  0  [lower  case 
Greek  eta]  such  that 


0  <  \y  ~  yo\  <  V  implies  \g(y)  -  y(y0)|  <  5,  i.e.,  | g(y)  -  x0|  <  5. 

(3) 

Combining  (3)  and  (2)  we  obtain 

g{y)  ~  xo 


0  <  \y  —  I/O  I  <  V  implies 

g(y)-xo 

f(g(y))-f\x  o) 


1 


Sinrp  g(y)~x 0  _  g(y)-gfao)  tiuc,  ollnws 
since  —  y_yo  ,  tins  snows 


lim 


f{g{y))  -  f(x o)  f'{x o) 

lis  si 

g(y)  -  g{yo ) 


<  e. 


y^yo  y-yo  fix  o) ' 

Hence  g'(yo)  exists  and  equals  jrn^s  ■ 


Example  2 

Let  n  be  a  positive  integer,  and  let  g(y)  =  ^fy  =  y 1^n.  If  n  is  even,  the 
domain  of  g  is  [0,  oo)  and,  if  n  is  odd,  the  domain  is  M.  In  either  case, 
g  is  strictly  increasing  and  its  inverse  is  f{x)  =  xn;  here  dom(/)  = 
[0,  oo)  if  n  is  even.  Consider  yo  hr  dom(y)  where  yo  7^  0,  and  write 
yo  =  Xq  where  xo  €  dom(/).  Since  f'(x 0)  =  nxg-1,  Theorem  29.9 
shows 


9' {Vo)  = 


nx, 


n— 1 


nyo 


1  _  ]L  l/n-l 

(n-l)/n  ~  ny° 


This  shows  the  function  g  is  differentiable  for  y  7^  0  and  the  rule 
for  differentiating  xn  holds  for  exponents  of  the  form  1/n;  see  also 
Exercise  29.15.  □ 


Theorem  29.9  applies  to  the  various  inverse  functions  encountered 
in  calculus.  We  give  one  example. 

Example  3 

The  function  f(x)  =  sinx  is  one-to-one  on  [—§,§],  and  it  is  tradi¬ 
tional  to  use  the  inverse  g  of  f  restricted  to  this  domain;  g  is  usually 
denoted  Sin-1  or  arcsin.  Note  that  dom(y)  =  [—1,1],  For  yo  =  sinxo 
in  (-1, 1)  where  x0  €  (-§,  f ),  Theorem  29.9  shows  y'(yo)  = 
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Since  1  =  sin2  xq  +  cos2  xq  =  +  cos2  xq  and  cosxq  >  0,  we  may 


write 


□ 


Exercises 

29.1  Determine  whether  the  conclusion  of  the  Mean  Value  Theorem  holds 
for  the  following  functions  on  the  specified  intervals.  If  the  conclusion 
holds,  give  an  example  of  a  point  x  satisfying  (1)  of  Theorem  29.3. 
If  the  conclusion  fails,  state  which  hypotheses  of  the  Mean  Value 
Theorem  fail. 

(a)  x 2  on  [—1,2],  (b)  sinx  on  [0,  tt] , 


(d)  i  on  [-1,1], 

(f)  sgn(x)  on  [-2,2], 


(c)  \x\  on  [-1,2], 
(e)  i  on  [1,3], 


The  function  sgn  is  defined  in  Exercise  17.10. 

29.2  Prove  |  cosx  —  cosy|  <\x  —  y\  for  all  x,y  £  R. 

29.3  Suppose  /  is  differentiable  on  R  and  /( 0)  =  0,  /( 1)  =  1  and  /( 2)  = 


1. 


(a)  Show  f'(x)  =  \  for  some  x  £  (0,  2). 

(b)  Show  f'{x)  =  y  for  some  x  £  (0,  2). 

29.4  Let  /  and  g  be  differentiable  functions  on  an  open  interval  I. 

Suppose  a,  b  in  I  satisfy  a  <  b  and  /(a)  =  f(b)  =  0.  Show 

f'{x)  +  f{x)g'{x)  =  0  for  some  x  £  (a,  b).  Hint :  Consider  h(x)  = 

f(x)e9<>x\ 

29.5  Let  /  be  defined  on  R,  and  suppose  |/(a;)  —  f(y)\  <  (x  —  y )2  for  all 
x,y  £  R.  Prove  /  is  a  constant  function. 

29.6  Give  the  equation  of  the  straight  line  used  in  the  proof  of  the  Mean 
Value  Theorem  29.3. 

29.7  (a)  Suppose  /  is  twice  differentiable  on  an  open  interval  I  and 

f"(x)  =  0  for  all  x  £  I.  Show  /  has  the  form  f(x)  =  ax  +  b  for 
suitable  constants  a  and  b. 

(b)  Suppose  /  is  three  times  differentiable  on  an  open  interval  I 
and  /"'  =  0  on  I.  What  form  does  /  have?  Prove  your  claim. 
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29.8  Prove  (ii)-(iv)  of  Corollary  29.7. 

29.9  Show  ex  <  ex  for  all  ieR. 

29.10  Let  /(x)  =  x 2  sin(i)  +  |  for  x  0  and  /( 0)  =  0. 

(a)  Show  /'( 0)  >  0;  see  Exercise  28.4. 

(b)  Show  /  is  not  increasing  on  any  open  interval  containing  0. 

(c)  Compare  this  example  with  Corollary  29.7(i). 

29.11  Show  sinx  <  x  for  all  x  >  0.  Hint:  Show  f(x)  =  x— sinx  is  increasing 
on  [0,  00). 

29.12  (a)  Show  x  <  tanx  for  all  x  £  (0,  |). 

(b)  Show  is  a  strictly  increasing  function  on  (0,  |). 

(c)  Show  x  <  |  sin  x  for  x  £  [0,  |]. 

29.13  Prove  that  if  /  and  g  are  differentiable  on  R,  if  /( 0)  =  g( 0)  and  if 
f'(x )  <  g'(x)  for  all  x  £  M,  then  /(x)  <  g(x)  for  x  >  0. 

29.14  Suppose  /  is  differentiable  on  R,  1  <  f'(x)  <  2  for  x  £  R,  and 
/( 0)  =  0.  Prove  x  <  /(x)  <  2x  for  all  x  >  0. 

29.15  Let  r  be  a  nonzero  rational  number  —  where  n  is  a  positive  integer, 
m  is  any  nonzero  integer,  and  m  and  n  have  no  common  factors. 
Let  h(x)  =  xr  where  dom(h)  =  [0, 00)  if  n  is  even  and  m  >  0, 
dom(/i)  =  (0,  00)  if  n  is  even  and  m  <  0,  dom(h)  =  R  if  n  is  odd 
and  to  >  0,  and  dom(/i)  =  R  \  {0}  if  n  is  odd  and  to  <  0.  Show 
h'(x)  =  rxr~ 1  for  x  £  dom(h),  x/0.  Hint:  Use  Example  2. 

29.16  Use  Theorem  29.9  to  obtain  the  derivative  of  the  inverse  g  = 
Tan-1  =  arctan  of  /  where  /(x)  =  tanx  for  x  £  (— f ,  f)- 

29.17  Let  /  and  g  be  differentiable  on  an  open  interval  /  and  consider 
a  £  /.  Define  h  on  I  by  the  rules:  h(x)  =  f(x)  for  x  <  a,  and 
h(x)  =  g(x)  for  x  >  a.  Prove  h  is  differentiable  at  a  if  and  only  if 
both  /(a)  =  g(a)  and  f'(a)  =  g'(a)  hold.  Suggestion:  Draw  a  picture 
to  see  what  is  going  on. 

29.18  Let  /  be  differentiable  on  R  with  a  =  sup{|//(a:)|  :  x  £  R}  <  1. 

(a)  Select  sq  £  R  and  define  sn  =  /(sn_i)  for  n  >  1.  Thus  si  = 
/(so),  s2  =  f{s  1),  etc.  Prove  (sn)  is  a  convergent  sequence. 
Hint:  To  show  that  (sn)  is  Cauchy,  first  show  |sn+i  —  sra|  < 
a\sn  —  sra-i|  for  n  >  1. 

(b)  Show  /  has  a  fixed  point,  i.e.,  f(s)  =  s  for  some  s  in  R. 
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30  *  L’Hospital’s  Rule 


In  analysis  one  frequently  encounters  limits  of  the  form 


lim 

x—>s 


f  0*0 

g  0) 


where  s  signifies  a,  a+,  a~ ,  oo  or  — oo.  See  Definition  20.3  concerning 
such  limits.  The  limit  exists  and  is  simply  g{x)  provided  the 

limits  lim^^s  f(x )  and  lim^s  g(x)  exist  and  are  hnite  and  provided 
limx_>.s  g(x)  ^  0;  see  Theorem  20.4.  If  these  limits  lead  to  an  inde¬ 
terminate  form  such  as  jj  or  then  L’Hospital’s  rule  can  often  be 
used.  Moreover,  other  indeterminate  forms,  such  as  oo  —  oo,  1°°,  oo°, 
0°  or  0  •  oo,  can  usually  be  reformulated  so  as  to  take  the  form  ~  or 
see  Examples  5-9.  Before  we  state  and  prove  L’Hospital’s  rule, 
we  will  prove  a  generalized  mean  value  theorem. 


30.1  Generalized  Mean  Value  Theorem. 

Let  f  and  g  be  continuous  functions  on  [a,  b]  that  are  differentiable 
on  ( a,b ).  Then  there  exists  [at  least  one }  x  in  ( a,b )  such  that 

f\x)[g{b)  -  g(a)}  =  g\x)[f(b)  -  f(a)}.  (1) 

This  result  reduces  to  the  standard  Mean  Value  Theorem  29.3 
when  g  is  the  function  given  by  g(x)  =  x  for  all  x. 


Proof 

The  trick  is  to  look  at  the  difference  of  the  two  quantities  in  (1)  and 
hope  Rolle’s  Theorem  will  help.  Thus  we  define 

h(x)  =  f[x)[g(b)  -  g(a )]  -  g{x)[f{b)  -  /(a)]; 

it  suffices  to  show  h'(x )  =  0  for  some  x  €  (a,  b).  Note 

h(a)  =  f(a)[g(b)  -  g(a )]  -  g(a)[f{b)  -  /(a)]  =  f{a)g{b)  -  g(a)f(b) 

and 

h(b)  =  f{b)\g{b)  -  g(a)}  -  g(b)[f{b)  -  /(a)]  =  -f{b)g(a)  +  g(b)f{a )  =  h{a). 

Clearly  h  is  continuous  on  [a,  6]  and  differentiable  on  (a,  b ),  so  Rolle’s 
Theorem  29.2  shows  h'(x)  =  0  for  at  least  one  x  in  (a,  b).  ■ 
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Our  proof  of  L’Hospital’s  rule  below  is  somewhat  wordy  but  is 
really  quite  straightforward.  It  is  based  on  the  elegant  presentation 
in  Rudin  [62].  Many  texts  give  more  complicated  proofs. 


30.2  L’Hospital’s  Rule. 

Let  s  signify  a,  a+ ,  a~ ,  oo  or  — oo  where  a  E  M,  and  suppose  f  and 
g  are  differentiable  functions  for  which  the  following  limit  exists: 


lim 

x— >-s 


g'  0) 


=  L. 


(i) 


if 


or  if 


lim  f(x)  =  lim  g(x)  =  0 

x— x— 


lim  I  I  =  +oo, 

x — ys 


then 


(2) 

(3) 


lim 

x — ys 


f(x) 

9(x) 


=  L. 


(4) 


Note  that  the  hypothesis  (1)  includes  some  implicit  assumptions: 
/  and  g  must  be  defined  and  differentiable  “near”  s  and  g'(x)  must  be 

f'(x) 

nonzero  “near”  s.  For  example,  if  lim^ _.a+  J ,)  {  exists,  then  there  is 

9  \x) 

an  interval  (a,  b )  on  which  /  and  g  are  differentiable  and  g ’  is  nonzero. 
The  requirement  that  g'  be  nonzero  is  crucial;  see  Exercise  30.7. 


Proof 

We  first  make  some  reductions.  The  case  of  limx^.a  follows  from  the 
cases  lim3,^.a+  and  lim^,^-,  since  lim X^ah(x)  exists  if  and  only  if 
the  limits  lim3,^a+  h(x )  and  lim^,^-  h(x)  exist  and  are  equal;  see 
Theorem  20.10.  In  fact,  we  restrict  our  attention  to  limx_m+  and 
lim-j^-oo,  since  the  other  two  cases  are  treated  in  an  entirely  analo¬ 
gous  manner.  Finally,  we  are  able  to  handle  these  cases  together  in 
view  of  Remark  20.11. 
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We  assume  a£lora  =  — oo.  We  will  show  that  if  —  oo  <  L  <  oo 
and  L\  >  L,  then  there  exists  a\  >  a  such  that 


a  <  x  <  ot\  implies 


fix) 

9{x ) 


<LX. 


(5) 


A  similar  argument  [which  we  omit]  shows  that  if  — oo  <  L  <  oo  and 
L2  <  L,  then  there  exists  a.2  >  a  such  that 


a  <  x  <  a 2  implies 


fix) 

aix) 


>  L2. 


(6) 


We  now  show  how  to  complete  the  proof  using  (5)  and  (6);  (5)  will 
be  proved  in  the  next  paragraph.  If  L  is  finite  and  e  >  0,  we  can 
apply  (5)  to  L\  =  L  +  e  and  (6)  to  L2  =  L  —  e  to  obtain  ot\  >  a  and 
0L2  >  cl  satisfying 


a  <  x  <  a\  implies 
a  <  x  <  «2  implies 


/  O) 
9  O) 
/  0) 
9(z) 


<  L  +  e, 
>  L  —  e. 


Consequently  if  a  =  min{o:i,  0:2}  then 


a  <  x  <  a  implies 


fix)  _ 
9ix) 


<  e; 


in  view  of  Remark  20.11  this  shows  limx_).a+  =  L  [if  a  =  —00, 
then  a+  =  —00].  If  L  =  —00,  then  (5)  and  the  fact  that  L\  is 
arbitrary  show  limx_^a+  =  —00.  If  L  =  00,  then  (6)  and  the  fact 

that  L2  is  arbitrary  show  limx_5.a+  =  00. 

It  remains  for  us  to  consider  L\  >  L  >  —  00  and  show  there 
exists  oq  >  a  satisfying  (5).  Let  (a,  b)  be  an  interval  on  which  /  and 
g  are  differentiable  and  on  which  g'  never  vanishes.  Theorem  29.8 
shows  either  g'  is  positive  on  (a,  b)  or  else  g'  is  negative  on  (a,  6). 
The  former  case  can  be  reduced  to  the  latter  case  by  replacing  g 
by  —g.  So  we  assume  g'{x)  <  0  for  x  €E  (a,  b),  so  that  g  is  strictly 
decreasing  on  (a,  b)  by  Corollary  29.7.  Since  g  is  one-to-one  on  (a,  b), 
g(x)  can  equal  0  for  at  most  one  x  in  (a,  b ).  By  choosing  b  smaller  if 
necessary,  we  may  assume  g  never  vanishes  on  (a,  b).  Now  select  K 
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so  that  L  <  K  <  L\.  By  (1)  there  exists  a  >  a  such  that 

ff(x\ 

a  <  x  <  a  implies  <  K. 

gix) 

If  a  <  x  <  y  <  a,  then  Theorem  30.1  shows 
fix)  -  f(y)  f\z ) 


g{x)  -  g(y)  g'{z) 


for  some  z  E  (x,  y ). 


Therefore 

a  <  x  <  y  <  a  implies 
If  hypothesis  (2)  holds,  then 


fix)  -  fjy) 

g(x)  -  g{y) 


so  (7)  shows 


lim 

x— >-a+ 


fix)  -  f(y) 

g{x)  -  g(y) 


fiv) 

g{y )’ 


(7) 


<  K  <  L\  for  a  <  y  <  a; 

9iv) 

hence  (5)  holds  in  this  case.  If  hypothesis  (3)  holds,  then  limx_>.a+ 
g(x)  =  +oo  since  g  is  strictly  decreasing  on  (a,  b).  Also  g{x)  >  0  for 
x  E  (a,  6)  since  g  never  vanishes  on  (a,  b).  We  multiply  both  sides 
of  (7)  by  9('Xg^y'> ,  which  is  positive,  to  see 

„  „  „  .  f{x)-f{y)  ^  Ts  g(x)-giy) 

a  <  x  <  y  <  a  implies  - — -  <  A  • - — - 

g{x)  g[x) 

and  hence 

fix)  R  gjx)-gjy)  fjy)  _  fjy)-Kgjy) 
gix)  '  g{x)  +  gix)  +  gix)  ' 

We  regard  y  as  fixed  and  observe 

fiy)  —  Kgiy) 
lim  JKyj  —  yyy>  =  0. 
i^a+  g(x) 

Hence  there  exists  a.2  >  a  such  that  «2  <  y  <  a  and 


a  <  x  <  «2  implies 


fix) 

gix) 


<  K  <  Lx. 


Thus  again  (5)  holds. 
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Example  1 

If  we  assume  familiar  properties  of  the  trigonometric  functions,  then 
limx_i.o  is  easy  to  calculate  by  L’Hospital’s  rule: 


sm  x  cos  x 

Inn - =  Inn - =  cos 

x— >-0  X  x-lO  1 

Note  f{x)  =  sin  a;  and  g(x)  =  x  satisfy  the  hypotheses  in  Theo¬ 
rem  30.2.  This  particular  computation  is  really  dishonest,  because 
the  limit  (1)  is  needed  to  prove  the  derivative  of  sinx  is  cosx.  This 
fact  reduces  to  the  assertion  that  the  derivative  of  sinx  at  0  is  1,  i.e., 
to  the  assertion 

sin  x  —  sin  0  sin  x 

lim -  =  lim -  =  1. 

i->0  X  —  0  X-10  X  □ 


(0)  =  1.  (1) 


Example  2 

We  calculate  lim^o  cos^2~1  ■  L’Hospital’s  rule  will  apply  provided  the 
limit  lirnx^o  ~  2™ x  exists,  but  and  this  has  limit  —  \ 

by  Example  1.  We  conclude 

cos  x  —  1  1 

Inn - t, - =  — . 

x-to  x2  2  □ 

Example  3 

2 

We  show  lim^^oo  =  0.  As  written  we  have  an  indeterminate 
of  the  form  — .  By  L’Hospital’s  rule,  this  limit  will  exist  provided 
lirrix^oo  exists  and  by  L’Hospital’s  rule  again,  this  limit  will 
exist  provided  limx_>00  exists.  The  last  limit  is  0,  so  we  conclude 

lim^oo  =  0.  □ 

Example  4 

Consider  limx_>0+  ~~p~  if  if  exists.  By  L’Hospital’s  rule,  this  appears 
to  be 

1/x 

inn  -  =  Too 

x— >0+  1 

and  yet  this  is  incorrect.  The  difficulty  is  that  we  should  have  checked 
the  hypotheses.  Since  limx^0+  loge  x  =  —  oo  and  limx_5.0+  x  =  0, 
neither  of  the  hypotheses  (2)  or  (3)  in  Theorem  30.2  hold.  To 
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find  the  limit,  we  rewrite  Ioge  x  as  — Iug,:  1 .  It  is  easy  to  show 

limx^o+  lugcl|1^'' 1  will  agree  with  lim^oo  y  loge  y  provided  the  lat¬ 
ter  limit  exists;  see  Exercise  30.4.  It  follows  that  limx_>o+  —fr—  = 
-  lirrp^oo  y  loge  y  =  -  oo.  □ 

The  next  five  examples  illustrate  how  indeterminate  limits  of 
various  forms  can  be  modified  so  that  L’Hospital’s  rule  applies. 


Example  5 

Consider  limx_j.o+  x\ogex.  As  written  this  limit  is  of  the  indetermi¬ 
nate  form  0  •  (— oo)  since  lima._>0+  x  =  0  and  linxr_>0+  loge  x  =  —  oo. 
By  writing  x  loge  x  as  ~[j^r  we  obtain  an  indeterminate  of  the  form 
so  we  may  apply  L’Hospital’s  rule: 

lim  x  loge  x  =  lim  — ^ —  =  lim  x,  =  —  lim  x  =  0. 

i->-0+  x— >-o+  -  >o+  — 9  x— >o+ 

X  Xz 

We  could  also  write  x  loge  x  as  1/ ioge  s  to  obtain  an  indeterminate 
of  the  form  jj.  However,  an  attempt  to  apply  L’Hospital’s  rule  only 
makes  the  problem  more  complicated: 


lim  x  log„  x 

x^0+ 


lim 

£— >0+ 


X 

1 

l°ge  x 


lim 

x— »o+ 


1 

-l 

z(loge  x)‘2 


=  —  lim  .T(logex)2. 

x— >-0+ 


□ 


Example  6 

The  limit  linxr_>o+  xx  is  of  the  indeterminate  form  0°.  We  write  xx  as 
ex  loge  x  [remember  x  =  eloge  x]  and  note  that  limx_;.o+  x  loge  x  =  0  by 
Example  5.  Since  g(x)  =  ex  is  continuous  at  0,  Theorem  20.5  shows 

lim  xx  =  lim  exlog-x  =  e°  =  1. 

x->0+  x— >0+  □ 


Example  7 

The  limit  liim^oo  xl^x  is  of  the  indeterminate  form  oo°.  We  write 
xl/x  as  e(loge  “l/® .  By  L’Hospital’s  rule 


lim 

x — ^OO 


logg  x 
x 


i 


=  lim  —  =  0. 

£—>•00  1 


x — >-oo 


Theorem  20.5  now  shows  lim. 


Xi/x  _  eo  _  p 


□ 
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Example  8 

The  limit  lima;^.00(l  —  -)x  is  indeterminate  of  the  form  1°°.  Since 


_  1  |  =  gXlog^l-l/x) 


we  evaluate 


lim  xloge  (1 - ^  =  lim  — —  lim 


x 


X  j  x^too 


x—>o o  — x 


-2 


x—>oo 

So  by  Theorem  20.5  we  have 


=  lim  —II -  =  — 1. 


lim  (1 - I  =  e  1 


x 


as  should  have  been  expected  since  limn_>0O(l  ~  b)n  =  e  1 


□ 


Example  9 

Consider  lim^^o  h{x)  where 

h(x)  = - —  =  (ex  —  1)_1  —  x_1  for  i^O. 

ex  —  1  x 


Neither  of  the  limits  limx_>.o(e:r  —  1)_1  or  lim^o  r_1  exists,  so 
limx_^o  h(x)  is  not  an  indeterminate  form  as  written.  However, 
limx_j.0+  h(x)  is  indeterminate  of  the  form  oo  —  oo  and  lining-  h{x) 
is  indeterminate  of  the  form  (— oo)  —  (— oo).  By  writing 


h(x) 


x  —  ex  T  1 
x(ex  —  1) 


the  limit  lmr^o  h(x)  becomes  an  indeterminate  of  the  form  jj.  By 
L’Hospital’s  rule  this  should  be 


1  -  ex 


lim  , 

x->o  xex  +  ex  —  1 


which  is  still  indeterminate  Note  xex  +  ex  —  1  ^  0  for  x  ^  0 
so  that  the  hypotheses  of  Theorem  30.2  hold.  Applying  L’Hospital’s 
rule  again,  we  obtain 


lim 


>o  xex  +  2ex 


1 

2' 


248  Differentiation 


Note  we  have  xex  +  2ex  ^  0  for  x  in  (— 2,oo).  We  conclude 
lim^o  h(x)  = □ 


Exercises 

30.1  Find  the  following  limits  if  they 
(a)  limM0  e2x~cos* 

(c)  lim^-^oo  ^2aT 

30.2  Find  the  following  limits  if  they 

(a)  limx_>.o  s;na,_x 
(c)  limx_^o(^ - -) 

30.3  Find  the  following  limits  if  they 
(a)  lim^ 

(c)  limx^0+ 

30.4  Let  /  be  a  function  defined  on  some  interval  (0,  a),  and  define 
g(y )  =  /(-)  for  y  £  (a_1,oo);  here  we  set  a-1  =  0  if  a  =  oo.  Show 
limx_),g+  f(x)  exists  if  and  only  if  lim^oo  g{y)  exists,  in  which  case 
these  limits  are  equal. 

30.5  Find  the  limits 

(a)  limx_K)(l  +  2x)1/x  (b)  limy_>00(l  +  | )v 

(c)  limx^.00(ea:  +  x)1^ 

30.6  Let  /  be  differentiable  on  some  interval  (c,  cx>)  and  suppose 
limx_).00[/(a;)  +  f(x)]  =  L ,  where  L  is  finite.  Prove  lim^oo  f(x)  =  L 
and  lirn^oo  f(x)  =  0.  Hint :  f(x)  =  /(^]e  • 

30.7  This  example  is  taken  from  [65,  p.  188]  and  is  due  to  Otto  Stolz  [64]. 
The  requirement  in  Theorem  30.2  that  g’{x)  7^  0  for  x  “near”  s  is 
important.  In  a  careless  application  of  L’Hospital’s  rule  in  which  the 
zeros  of  g'  “cancel”  the  zeros  of  /',  erroneous  results  can  be  obtained. 
For  x  £  R,  let 

f(x)  =  x  +  cosxsmx  and  g{x)  =  eslnx(x  +  cos  a:  sin  x). 

(a)  Show  lim^oo  f(x)  =  lim^oo  g(x)  =  +00. 

(b)  Show  f'(x)  =  2(cosa;)2  and  g'{x)  =  esinx  coszpcosa:  +  f(x)]. 


exist. 


(b) 

limx_s.0 

1— COS  X 

X2 

(d) 

limx_s.0 

y/l-\-X  —  y/1—  X 
X 

exist. 

(b) 

lirn^o 

tan  x—x 

X3 

(d) 

limx_>o 

(cosa;)1/®2 

exist. 

(b) 

limx_).0o  zsm(1/x) 

(d) 

limx^0 

1— cos  2x— 2x2 

xA 
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(c)  Show 


f'jx)  _  2e~  sin  x  cos  x 
g' (x)  2  cos  x-\-f(x) 


if  cos  x  0  and  x  >  3. 


(d) 


Show  lim^oo 
does  not  exist. 


2e~  sin  x  cos  x 

2  cos  x-\-f(x ) 


0  and  yet  the  limit  limx_>.00 


§31  Taylor’s  Theorem 

31.1  Discussion. 

Consider  a  power  series  with  radius  of  convergence  R  >  0  [R  may 
be  +oo]: 

OO 

f(x)  =  ^2akxk.  (1) 

k= 0 

By  Theorem  26.5,  /  is  differentiable  in  the  interval  \x\  <  R  and 

OO 

f\x )  =  y ^kakxk~1. 

k= 1 

The  same  theorem  shows  f  is  differentiable  for  |x|  <  R  and 

OO 

f”(x)  =  X!  k(k  -  1  )akxk~2. 

k= 2 

Continuing  in  this  way,  we  find  the  nth  derivative  / ^  exists  for 
|x|  <  R  and 

OO 

f(n\x)  =  k(k  -  1)  •  •  •  (k  -  n  +  1  )akxk~n. 

k=n 

In  particular, 

/(n)(0)  =  n(n  —  1)  •  •  •  (n  —  n  +  l)an  =  n\an. 

This  relation  even  holds  for  n  =  0  if  we  make  the  convention  f  -  '1  =  / 
and  recall  the  convention  0!  =  1.  Since  /^(0)  =  k\ak,  the  original 
power  series  (1)  has  the  form 

f(x )  =  J2Jk\  x  ’  \x\<R-  (2) 

k= 0 
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As  suggested  at  the  end  of  §26,  we  now  begin  with  a  function  / 
and  seek  a  power  series  for  /.  The  last  paragraph  shows  /  should  pos¬ 
sess  derivatives  of  all  orders  at  0,  i.e.,  /'( 0),  /"( 0),  f'"{ 0), . . .  should 
all  exist.  For  such  /,  formula  (2)  might  hold  for  some  R  >  0,  in  which 
case  we  have  found  a  power  series  for  /.  □ 


One  can  consider  Taylor  series  that  are  not  centered  at  0,  just  as 
we  did  with  the  power  series  in  Example  7  on  190. 


31.2  Definition. 

Let  /  be  a  function  defined  on  some  open  interval  containing  c.  If  / 
possesses  derivatives  of  all  orders  at  c,  then  the  series 


OO 


E 


/(fc)(c) 


k\ 


{x 


) 


(1) 


is  called  the  Taylor  series  for  f  about  c.  For  n  >  1,  remainder  Rn(x) 
is  defined  by 


Rn(x ) 


IT —  1 


/<*)- 


k= 0 


(2) 


Of  course  the  remainder  Rn  depends  on  /  and  c,  so  a  more  ac¬ 
curate  notation  would  be  something  like  Rn(f\c\x).  The  remainder 
is  important  because,  for  any  x , 

°° 

f(x)  =  y  — — — ( x  —  c)k  if  and  only  if  lim  Rn(x)  =  0. 

J  h\  n— >oo 

k= 0 

We  will  show  in  Example  3  that  /  need  not  be  given  by  its  Taylor 
series,  i.e.,  that  limn^,00  Rn(x)  =  0  can  fail.  Since  we  want  to  know 
when  /  is  given  by  its  Taylor  series,  our  various  versions  of  Taylor’s 
Theorem  all  concern  the  nature  of  the  remainder  Rn. 


31.3  Taylor’s  Theorem. 

Let  f  be  defined  on  (a,  b )  where  a  <  c  <  b;  here  we  allow  a  =  — oo 
or  b  =  oo.  Suppose  the  nth  derivative  exists  on  ( a,b ).  Then  for 
each  x  c  in  (a,  b )  there  is  some  y  between  c  and  x  such  that 

fW  (y) 

Rn(x)  =  J—y{x-c)n. 

n\ 
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The  proof  we  give  is  due  to  James  Wolfe1  [71];  compare 
Exercise  31.6. 


Proof 

Fix  a;  t -  c  and  n  >  1.  Let  M  be  the  unique  solution  of 

71—1 

f(x)  =  y  ,,ry(x  -  °f  + 


/W(c).  k  M  (x  —  c)r 


k= 0 


k\ 


n\ 


(1) 


and  observe  we  need  only  show 

f{n\y)  =  M  for  some  y  between  c  and  x.  (2) 

[To  see  this,  replace  M  by  f^n\y)  in  Eq.  (1)  and  recall  the  definition 
of  Rn(x).\  To  prove  (2),  consider  the  difference 


71—1 


9(t)  =  Y 


k= 0 


/(fc)(c 

k\ 


-( t-c)k  + 


M(t  -  c)r 


n\ 


-  m. 


(3) 


A  direct  calculation  shows  g(c)  =  0  and  g(k\c)  =  0  for  k  <  n.  Also 
g{x)  =  0  by  the  choice  of  M  in  (1).  By  Rolle’s  theorem  29.2  we 
have  g'(xi)  =  0  for  some  x\  between  c  and  x.  Since  g'{c)  =  0,  a 
second  application  of  Rolle’s  theorem  shows  g"(x 2)  =  0  for  some  X2 
between  c  and  x\.  Again,  since  g"{c)  =  0  we  have  g"'(x 3)  =  0  for 
some  X3  between  c  and  X2  ■  This  process  continues  until  we  obtain  xn 
between  c  and  xn-\  such  that  g^n\xn)  =  0.  From  (3)  it  follows  that 
g(n\t)  =  M  —  f(n\t)  for  all  t  6  (a,  6),  so  (2)  holds  with  y  =  xn.  ■ 


31.4  Corollary. 

Let  f  be  defined  on  (a,  b )  where  a  <  c  <  b.  If  all  the  derivatives  f  ^ 
exist  on  ( a,b )  and  are  bounded  by  a  single  constant  C,  then 

lim  Rn{x)  =  0  for  all  x  £  (a,  b). 

n — foo 

Proof 

Consider  x  in  (a,  b).  From  Theorem  31.3  we  see 

| Rn(x)\  <  —\x  —  c\n  for  all  n. 
n\ 


1My  undergraduate  real  analysis  teacher  in  1954-1955. 
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\j. _ q\TI 

Since  Hindoo  ,  =  0  by  Exercise  9.15,  we  conclude  limn_>.0O 
Rn(x)  =  0.  '  ■ 

Example  1 

We  assume  the  familiar  differentiation  properties  of  ex,  sinx,  etc. 
(a)  Let  /(x)  =  ex  for  x  €  M.  Then  f^n\x)  =  ex  for  all  n  = 
0,1,2,...,  so  /(”)( 0)  =  1  for  all  n.  The  Taylor  series  for  ex 
about  0  is 

oo  1 

Es1*' 


k= 0 


For  any  bounded  interval  (-M,  M )  in  M  all  the  derivatives  of 
/  are  bounded  [by  eM ,  in  fact],  so  Corollary  31.4  shows 

~  1 


ex  =  y  —xk  for  all  x  € 
k\ 


k= 0 


(b)  If  f(x)  =  sinx  for  x£l,  then 
/M(x)  = 


cosx 

—  sin  x 

—  cosx 
sinx 


thus 


fH(0)  =  {  -i 
0 


n  =  1,5,9,... 
n  =  2, 6, 10, . . . 
n  =  3,7,ll,... 
n  =  0,4, 8, 12,...; 


n  =  1,  5,  9, . . . 
n  =  3,7,ll,... 
otherwise. 


Hence  the  Taylor  series  for  sin  x  about  0  is 


E 

k= 0 


(2k  +  1)! 


x 


2k+l 


The  derivatives  of  /  are  all  bounded  by  1.  so 


sm  x  = 


00  ( _ 1 \k 

— — —7T7X2k+1  for  all  x  € 


k= 0 


(2fc  +  l)!‘ 


□ 
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Example  2 

In  Example  2  of  §26  we  used  Abel’s  theorem  to  prove 
,  „  „  111111 
°Se  -  -2  +  3-  4  +  5_6  +  7  ‘  ^ 

Here  is  another  proof,  based  on  Taylor’s  Theorem.  Let  f(x)  = 
loge(l  +  x)  for  x  E  (—1,  oo).  Differentiating,  we  find 

f'{x)  =  {  1  +  x)-1,  f"(x)  =  -(  1  +  x)-2,  f"'{x)  =  2(1 +  x)-3, 


etc.  A  simple  induction  argument  shows 

/(«)(x)  =  (-l)”+1(„-l)!(l+x)-"  for  n>  1.  (2) 

In  particular,  f(n\ 0)  =  (— 1  )n+1(n  —  1)!,  so  the  Taylor  series  for  / 
about  0  is 


E 

k= 1 


(— l)fc+1  k  x 2  x3  x4  x5 

~^x ^  =  "-y  +  y-T  +  y-- 


We  also  could  have  obtained  this  Taylor  series  using  Example  1  in 
§26,  but  we  need  formula  (2)  anyway.  We  now  apply  Theorem  31.3 
with  a  =  —1,  b  =  +oo,  c  =  0  and  x  =  1.  Thus  for  each  n  there  exists 
yn  €  (0, 1)  such  that  Rn(  1)  =  - — Equation  (2)  shows 


hence 


Rn(  1) 


(— l)n+1(n  —  1)! 
(1  +  yn)nn\ 


Rn(  1)| 


1  1 

(1  +  yn)nn  <  n 


for  all  n. 


Therefore  limn^,00  Rn(  1)  =  0,  so  the  Taylor  series  for  /,  evaluated 
at  x  =  1,  converges  to  /( 1)  =  loge2,  i.e.,  (1)  holds.  □ 


The  next  version  of  Taylor’s  theorem  gives  the  remainder  in  inte¬ 
gral  form.  The  proof  uses  results  from  integration  theory  that  should 
be  familiar  from  calculus;  they  also  appear  in  the  next  chapter. 

31.5  Taylor’s  Theorem. 

Let  f  be  defined  on  (a,  b)  where  a  <  c  <  b,  and  suppose  the  nth 
derivative  f  ^  exists  and  is  continuous  on  ( a,b ).  Then  for  x  €  (a,b) 
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we  have 

=  r  (x(~ty'v  f{n)^dt-  « 

Jc  \n  —  1)' 

Proof 

For  n—  1,  Eq.  (1)  asserts 

Ri  (x)  =  f(x)  -  f(c)  =  f  f\t)dt ; 

J  C 

this  holds  by  Theorem  34.1.  For  n  >  2,  we  repeatedly  apply 
integration  by  parts,  i.e. ,  we  use  mathematical  induction.  So,  as¬ 
sume  (1)  above  holds  for  some  n,  n  >  1.  We  evaluate  the  integral  in 
(1)  by  Theorem  34.2,  using  u(t)  =  f^(t),  v'(t)  =  ,  so  that 

u'(t )  =  f(n+1\t)  and  v{t)  =  —  .  We  obtain  Rn(x ) 


/X 

v(t)u'  (t)  dt 

= f^\X)  •  o + /W(c) ~c)ra  +  r  ~*)w /(»+i)  (t)  dt. 

n\  Jc  n\ 

The  definition  of  in  Definition  31.2  shows 


-^n+l(®)  —  Rn{%) 


/W(c 


-(s-c)"; 


n\ 

hence  from  (2)  we  see  that  (1)  holds  for  n  +  1. 


(2) 

(3) 


31.6  Corollary. 

If  f  is  as  in  Theorem  31.5,  then  for  each  x  in  (a,  b )  different  from  c 
there  is  some  y  between  c  and  x  such  that 

(nr  —  7/1^'  1  /  \ 

Jt.fr)  =  fr  -  c)  ■  /W(»).  (1) 

This  form  of  Rn  is  known  as  Cauchy’s  form  of  the  remainder. 


Proof 

We  suppose  x  <  c,  the  case  x  >  c  being  similar.  The  Intermediate 
Value  Theorem  for  Integrals  33.9  shows 


1 


(T  ~  *)"  1  f(n) 

(n  —  1)!  1 


(t)  dt 


(x  —  y)n  1 
(n-  1)! 


) 


(2) 


c  —  x 
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for  some  y  in  (x,c).  Since  the  integral  in  (2)  equals  —Rn(x)  by 
Theorem  31.5,  formula  (1)  holds.  ■ 


Recall  that,  for  a  nonnegative  integer  n,  the  binomial  theorem 
tells  us 


(•+«*-£  UK" 


k= 0 


7  ?i — k 


where  (”)  =  1  and 


n 


n 


!  n(n  —  1)  •  •  •  (n  —  k  +  1) 


Kk  J  k\{n  —  k)\ 

Let  a  =  x  and  6=1;  then 


k\ 


for  1  <  k  <  n. 


(l+x)”  =  l  +  £ 


k= 1 


n(n  —  1)  ■  ■  ■  (n  —  k  +  1)  k 
k\  X  ' 


This  result  holds  for  some  values  of  x  even  if  the  exponent  n  is  not 
an  integer,  provided  we  allow  the  series  to  be  an  infinite  series. 

We  next  prove  this  using  Corollary  31.6.  Our  proof  is  motivated 
by  that  in  [55]. 


31.7  Binomial  Series  Theorem. 

1/aGl  and  |x|  <  1,  then 


(l+z)«  =  l  +  £ 


k= 1 


a(a  —  1)  •  •  •  (a  —  k  +  1) 
k\  ; 


(1) 


Proof 

For  k  =  1,2,3,...,  let  ak  =  — — 1\[''  /,+1).  If  a  is  a  nonnegative 
integer,  then  ak  =  0  for  k  >  a  and  (1)  holds  for  all  x  as  noted  in 
our  discussion  prior  to  this  theorem.  Henceforth  we  assume  a  is  not 
a  nonnegative  integer  so  that  ak  ^  0  for  all  k.  Since 


Ok+l 


lim 

k — ^oo 


a  —  k 
k  +  1 


=  1, 


lim 

k — ^oo 
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the  series  in  (1)  has  radius  of  convergence  1;  see  Theorem  23.1  and 
Corollary  12.3.  Lemma  26.3  shows  the  series  'ffkakXk~1  also  has 
radius  of  convergence  1,  so  it  converges  for  \x\  <  1.  Hence 

lint  nanxn_1  =  0  for  |x|  <  1.  (2) 

n— >•  oo 


Let  f(x )  =  (1  +  x)a  for  \x\  <  1.  For  n  =  1,  2, . . .,  we  have 

f^n\x)  =  a{a  —  1  )■■■  (a  —  n+  1)(1  +  x)a~n  =  n\an{  1  +  x)a~n . 

Thus  /(n)(0)  =  n\an  for  all  n  >  1,  and  the  series  in  (1)  is  the  Taylor 
series  for  /. 

For  the  remainder  of  this  proof,  x  is  a  fixed  number  satisfying 
|x|  <  1.  By  Corollary  31.6,  with  c  =  0,  for  each  n,  there  is  yn 
between  0  and  x  such  that 

v  (  \  {x-yn)11-1  (n)  (x-2/n)n_1  n 

Rn{x)  =  x  ■  — - ——  ’{yn)  =  x  ■  — - ——n\an{  1  +  yn 

(n  —  lj!  (n  —  1J! 

So 


\Rn{x)\  <  |x| 


x-yn 


1  +  2/n 


n—  1 


n|an|(l  +  yn) 


a—1 


We  easily  show  that 
x-y 


1  +  y 


<  |x|  if  y  is  between  0  and  x; 


indeed,  note  y  =  xz  for  some  z  6  [0, 1],  so 


x-y 

x  —  xz 

1  -  z 

i  +  y 

1  +  xz 

1  +  xz 

<  Ixl 


since  1  +  xz  >  1  —  z.  Therefore,  (3)  implies 
\Rn{x)\  <  \x\nn\an\{\  + 


(3) 


The  sequence  (1  +  yn )"^1  is  bounded,  because  the  continuous  func¬ 
tion  y  ->  (1  +  y)01^1  is  bounded  on  [—  |x|,|x|],  so  from  (2)  and 
Exercise  8.4,  we  conclude  lint nRn{x)  =  0,  so  that  (1)  holds.  ■ 


We  next  give  an  example  of  a  function  /  whose  Taylor  series  ex¬ 
ists  but  does  not  represent  the  function.  The  function  /  is  infinitely 
differentiable  on  M,  i.e.,  derivatives  of  all  order  exist  at  all  points 
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y 


2 


3 


fix)  =e~ llx  for  x  >  0 


FIGURE  31.1 


of  R.  The  example  may  appear  artificial,  but  the  existence  of  such 
functions  [see  also  Exercise  31.4]  is  vital  to  the  theory  of  distribu¬ 
tions,  an  important  theory  related  to  work  in  differential  equations 
and  Fourier  analysis. 

Example  3 


Let  f(x )  =  e  l/x  for  x  >  0  and  f(x)  =  0  for  x  <  0;  see  Fig.  31.1. 
Clearly  /  has  derivatives  of  all  orders  at  all  x  ^  0.  We  will  prove 


/W(0)  =  0  for  n  =  0,l,2,3,.... 


(1) 


Hence  the  Taylor  series  for  /  is  identically  zero,  so  /  does  not  agree 
with  its  Taylor  series  in  any  open  interval  containing  0.  First  we  show 
for  each  n  there  is  a  polynomial  pn  of  degree  2 n  such  that 


f(n\x)  =  e  l^xpn{l/x)  for  x  >  0. 


(2) 


This  is  obvious  for  n  =  0;  simply  set  po(t)  =  1  for  all  t.  And  this  is 
easy  for  n  =  1  and  n  =  2;  the  reader  should  check  (2)  holds  with 
n  =  1  and  pi(t)  =  t2  and  (2)  holds  with  n  =  2  and  P2(t)  =  t4  —  2 13. 
To  apply  induction,  we  assume  the  result  is  true  for  n  and  write 


pn(t)  =  a0  +  a±t  +  a2t2  H - 1  a2„t2"  where  a2n  7^  0. 


Then  for  i>0we  have 


2  n 


lk=0 
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and  a  single  differentiation  yields 

2  n 


f{n+1\x)  =  e-1/2 


°-E 


kctk 

v.fc+1 


k= 1 


+ 


2  n 

E 

.fe=0 


Ofc 

Xfc 


=>-!/*  .  /  2_ 


The  assertion  (2)  is  now  clear  for  n  +  1;  in  fact,  the  polynomial  pn+\ 
is  evidently 


2  n 


Pn+l(t)  =  -  ^2  kaktk+1  + 


k= 1 


2n 


^2  aktk 


,k= 0 


(i2), 


which  has  degree  2n  +  2. 

We  next  prove  (1)  by  induction.  Assume  f^n\ 0)  =  0  for  some 
n  >  0.  We  need  to  prove 

a:— >0  X  —  0  a:— >0  X 

Obviously  linx^o-  j/^(x)  =  0  since  f(n\x)  =  0  for  all  x  <  0.  By 
Theorem  20.10  it  suffices  to  verify 

lim  -/(n)(x)  =  0. 

®->o+  xJ 


In  view  of  (2),  it  suffices  to  show 


lim  e~l/xq  (  —  1=0 
*->•0+  \x  J 

for  any  polynomial  q.  In  fact,  since  g(l/x)  is  a  finite  sum  of  terms  of 
the  form  bk{\/x)k ,  where  k  >  0,  it  suffices  to  show 

lim  (  —  j  '  e~l/x  =  0  for  fixed  k  >  0. 

£->•0+  V  x  ) 


As  noted  in  Exercise  30.4,  it  suffices  to  show 

k 

lim  yke~y  =  lim  —  =  0, 

y— >-oo  y— >•  oo 


(3) 


and  this  can  be  verified  via  k  applications  of  L’Hospital’s  Rule  30.2. 

□ 


As  we  observed  in  Remark  2.4  on  page  12,  Newton’s  method 
allows  one  to  solve  some  equations  of  the  form  /(x)  =  0. 
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FIGURE  31.2 

31.8  Newton’s  Method. 

Newton’s  method  for  finding  an  approximate  solution  to  f(x)  =  0  is 
to  begin  with  a  reasonable  initial  guess  xq  and  then  compute 


Xn  —  Xn— i 


/  Qn-l) 
f'(Xn-l) 


for  n  >  1. 


Here  xn  is  chosen  so  that  (xn,0)  lies  on  the  line  through 
(xn-i,  f(xn-i))  having  slope  f(xn- 1).  See  Fig.  31.2.  Often  the 
sequence  ( xn )  converges  rapidly  to  a  solution  of  f(x)  =  0.  □ 


31.9  Secant  Method. 

A  similar  approach  to  approximating  solutions  of  f(x)  =  0  is  to  start 
with  two  reasonable  guesses  xq  and  x\  and  then  compute 


%n  —  %n—  1 


/(aw_i)(xn_2  ~xn. i) 

f(xn. 2)  -  f{xn- 1) 


Here  xn  is  chosen  so  that  ( xn,0 )  lies  on  the  line  through 
(■ xn-i ,  f(xn- 1))  and  (xn_2,  /(xn_2)).  See  Fig.  31.3.  □ 
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Example  4 

Consider  the  equation  x10  +  x  —  1  =  0.  Let  /(x)  =  x 10  +  x  —  1. 
The  equation  /(x)  =  0  will  have  at  least  two  solutions,  because 
/( 0)  =  -1  and  linij-Kx,  /(s)  =  lim^-oo  f(x)  =  +oo.  In  fact,  it 
has  exactly  two  solutions,  because  f'{x)  =  10x9  +  1  is  0  at  only  one 
point,  y  =  —  1/v^lO  ~  —0.774,  so  that  /  decreases  on  (— oo ,y)  and 
increases  on  (y,  oo). 

We  will  illustrate  both  approximation  methods,  starting  with 
Newton’s  method.  Since  /( 0)  =  —1  and  /( 1)  =  1.  a  good  initial 
guess  for  one  of  the  solutions  would  be  xo  =  1.  We  omit  the  cal¬ 
culations,  which  we  did  on  the  spreadsheet  Excel.  With  xo  =  1  and 
Newton’s  method,  we  obtained  xi  ~  0.909090909,  x 2  ~  0.852873482, 
x3  w  0.836193375,  x4  ~  0.835083481  and  x5  w  0.835079043.  All  sub¬ 
sequent  approximations  equaled  xs’s,  so  this  is  surely  the  value  to 
9-place  accuracy. 

Since  /(— 1)  =  —1,  the  other  solution  is  less  than  —1,  and 
since  /(— 2)  =  1,021,  a  good  initial  guess  would  be  close  to  — 1. 
But  we  started  at  xo  =  —2  to  see  what  happens.  We  obtained 
x  1  »  -1.800546982,  x2  »  -1.621810423,  x3  »  -1.462802078, 
x4  ~  -1.324100397,  x5  «  -1.209349769,  x6  w  -1.126853632, 
x7  «  -1.085350048,  x8  «  -1.076156798,  x9  w  -1.075766739,  and 
xio  ~  —1.075766066.  All  further  values  of  xn  approximated  xiq.  Of 
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course,  xo  =  —2  was  a  poor  choice,  and  xo  =  —1.2  would  have  been 
more  sensible.  With  this  choice,  X5  «  —1.075766066. 

As  we  will  see,  with  the  secant  method  the  convergence  is  a  bit 
slower.  To  find  the  positive  solution,  we  started  with  xq  =  2  and 
x\  =  1.  We  obtained  xg  ~  0.835079043,  so  it  took  about  twice  as 
many  iterations  to  get  9-place  accuracy  as  with  Newton’s  method. 
For  the  other  solution,  we  started  with  xo  =  —2  and  x\  =  —1,  and 
we  obtained  9-place  accuracy  at  xs  ~  —1.075766066.  If  you  look 
at  a  graph,  you  will  see  why  choosing  guesses  on  each  side  of  the 
true  solution  can  be  efficient.  If  we  had  started  with  xo  =  —  2  and 
x\  =  —1.5,  we  would  not  have  reach  9-place  accuracy  until  X12.  □ 

Unlike  much  of  calculus,  there  isn’t  a  single  easily- found  and 
easily-applied  theorem  justifying  the  use  of  either  of  these  methods. 
We’ll  prove  two  such  theorems,  Theorems  31.12  and  31.13.  They 
might  be  of  value  when  studying  the  theory  or  when  writing  a  pro¬ 
gram  to  implement  a  method.  But  for  simple  problems,  it  is  much 
more  efficient  to  simply  assume  and  hope  that  the  method  will  suc¬ 
ceed,  and  then  use  common  sense  to  assess  whether  the  method 
worked. 

The  secant  method  predates  Newton’s  method,  but  it  does  not 
seem  as  well  known.  In  fact,  the  secant  method  is  an  example  of 
the  regula  falsi  (false  position)  method  for  approximating  solutions 
of  equations,  which  even  appears  in  the  Phind  Papyrus  attributed 
to  the  scribe  Ahrnes.  It  works  in  many  examples,  but  a  computer 
implementation  would  need  to  avoid  a  premature  attempt  to  divide 
by  0.  One  advantage  to  this  method  is  that  the  derivatives  of  / 
might  be  very  complicated  or  not  even  exist.  Another  advantage  to 
this  method  is  that  it  can  be  used  to  find  approximate  solutions 
of  equations,  like  cosx  —  x  =  0,  when  studying  functions  in  alge¬ 
bra  or  trigonometry.  The  methodology  also  might  be  useful  when 
motivating  the  sequential  definition  of  the  derivative. 

We  now  work  toward  a  theorem  providing  hypotheses  that  assure 
us  that  Newton’s  method  works.  We  will  need  a  technical  lemma 
about  sequences. 
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31.10  Lemma. 

Let  (an)  be  a  sequence  of  nonnegative  numbers,  and  let  C  and  5  be 
positive  numbers  satisfying  C5  <  1. 

(a)  If  ao  <  5  and  an  <  Cal_1  for  n  >  1,  then 

an  <  ( CS )2  _1ao  for  all  n  >  0. 

(b)  If  max{ao,  ai}  <  5  and  an  <  C  max{a„_i,  an-2}2  for  n  >  2, 
then 


max{a2n)  «2n+i}  <  (CS)2  1max{ao,ai}  for  all  n  >  0. 

Proof 

We  prove  (a)  by  mathematical  induction,  noting  first  that  it  is 
obvious  for  n  =  0  and  that  a\  <  Coq  <  Cda q.  In  general,  if 
an  <  (C<5)2"_1a0,  then 

an+ 1  <  Cal  <  C[(C5)2"~1a0]2  <  C2n+1~152n+1~2dao  =  (Cdf^^ao. 

For  (b),  we  write  M  =  max{ao,ai},  so  that  M  <5  and  we  need 
to  show 


max{a2n,  02n+i}  <  (CS)2  iM  for  all  n  >  0. 

This  is  trivial  for  n  =  0.  In  general,  if  we  have  max{o2n,  02n+i}  < 
(C'5)2™-1M,  then 

a2n+2  <  C max{a2n+i, o2n}2  <  C^CSf'^M]2 


=  C'2n+1~lS2n+1-2M2  <  C2n+1-]d2n+1-26M  =  (C5)2n+1-lM, 


and 


a2n+3<Cmax{a2n+2,a2n+i}z  <Cmax{(C5)2n+1  1M,(CS)2"  iM} 


\2n  — 1  71  2 


<  C[(C<5)2n-1M]2  =  C2B+1-153B+1-2M3  <  C2n+1~152n+1~2SM  =  (C6)an+1~1M. 

Thus  max{a2n+2)  ®2n+3}  <  ( C'<5)2"+1_1M ,  and  the  induction  proof 
of  (b)  is  complete.  ■ 
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31.11  Discussion. 

We  assume  /  is  defined  and  differentiable  on  an  open  interval  J  = 
( c,d ).  A  glance  at  the  definition 


f(Xn-l) 


suggests  it  is  reasonable  to  assume  \f'\  is  bounded  away  from  0  on  J. 
This  implies  f  is  always  positive  or  always  negative  [Intermediate 


Value  Theorem  for  Derivatives  29.8  on  page  236].  Therefore  /  is 
strictly  increasing  or  strictly  decreasing  on  J,  and  /  is  one-to-one 
[Corollary  29.7].  In  addition,  we  assume  f"  exists  on  J  and  |/,,|  is 
bounded  above. 

Suppose  there  exists  <5o  >  0  with  the  property  that  /( x)  =  0  for 
some  x  in  the  closed  interval  I  =  [c  +  <5o,  d  —  <5o]  C  J.  We  will  show 
that  if  the  initial  value  xq  of  Newton’s  sequence  is  sufficiently  close 
to  x ,  then  the  iterates  xn  in  Newton’s  method  converge  to  x.  To 
see  how  this  goes,  we  assume  for  now  that  each  xn  is  indeed  in  the 
interval  J.  From  the  definition,  we  have 


f'(xn- 1)  •  ( xn-i  -  x)  -  f(xn- j) 
f{xn- 1) 


xn  -  x  =  xn-i  -  x  - 


By  Taylor’s  Theorem  31.3  on  page  250,  with  n  =  2,  c  =  xn-\  and 
x  =  x,  we  obtain 


for  some  yn  between  xn-\  and  x.  Hence 


so 


Therefore 


xn  ~  x\  <  C \xn-\  —  x 


so  that 
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where  C  =  2inf{f/'(x)|-xg j} •  Now  select  8  >  0  so  that  C5  <  1.  By 
Lemma  31.10(a),  with  an  =  \xn  —  x|,  we  could  conclude 

| xn  —  x\  <  (Cd)2”-1  \xq  —  x|  for  all  n  >  0,  (1) 

if  we  could  arrange  for  |xo  —  x|  =  ao  <  8. 

The  inequalities  (1)  are  our  goal,  and  would  assure  us  the 
sequence  (xn)  converges  to  x,  but  we  need  to  backtrack  and  de¬ 
termine  how  to  be  sure  each  xn  is  in  the  interval  J,  as  well  as 
arrange  for  |xo  —  x|  <8.  In  addition  to  requiring  C8  <  1,  we 
will  need  to  choose  8  so  that  28  <  8q.  Finally,  we  select  xo  in 
I  so  that  |/(xo)|  <  where  m  =  inf{|/'(x)|  :  x  E  J}.  Note 
(xo  —  28,  xo  +  28)  C  (xo  —  8o,xq  +  do)  Q  J ■  We  also  have 

|x0  -  x|  <  d,  (2) 


because  by  the  Mean  Value  Theorem  29.3,  there  is  yo  between  xo 
and  x  such  that 


|x0  -  x 


|/(x0)  -  /(x)l 
l/'(yo)| 


\f(xp)\  <  \f(x0)\ 
\f'{yo)\  ~  rn 


By  (1)  and  (2),  for  each  n,  we  have  \xn  —  x|  <  |xo  —  x|  <  d;  thus 
\xn  —  xo |  <  \xn— x|  +  |x  —  xo|  <  2d,  so  that  each  xn  is  in  the  interval  J. 
We  summarize  what  we  have. 


31.12  Theorem. 

Consider  a  function  f  having  a  zero  x  on  an  interval  J  =  (c,d),  and 
assume  f"  exists  on  J.  Assume  \f"\  is  hounded  above  on  J  and  \f'\ 
is  bounded  away  from  0  on  J .  Choose  do  >  0  so  that  I  =  [c  +  do, 
d  —  do]  C  J  is  a  nondegenerate  interval  containing  x  and  so  that 
[c  +  do,  d  —  do]  C  J .  Let 

=  sup{|/"(x)|  :  x  E  J} 

2inf{|//(x)|  :  x  E  J}’ 

and  select  8  >  0  so  that  28  <  do  and  C8  <  1.  Let  m  =  inf{|/'(x)|  : 
x  E  J}.  Consider  any  xp  in  I  satisfying  |/(xo)|  <  md.  Then  the 
sequence  of  iterates  given  by  Newton’s  method, 

f{xn- 1) 
f'{xn- 1) 


%n  —  %n—  1 


for  n  >  1 
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is  a  well-defined  sequence  and  converges  to  x.  Also, 

\xn  —  x\  <  C\xn-\  —  x\2  for  n  >  1,  and  (1) 

\xn  —  x\  <  (C'<5)2"~1|xo  —  x\  for  n  >  0.  (2) 

In  view  of  (1),  the  convergence  of  (xn)  is  said  to  be  “quadratic 
convergence.”  Here  is  an  analogous  theorem  for  the  secant  method. 
Comparing  its  conclusion  with  that  in  Theorem  31.12,  it  appears 
that  it  will  take  about  twice  as  many  iterations  using  the  secant 
method  to  get  the  same  accuracy  as  using  Newton’s  method.  This  is 
what  happened  in  Example  4  on  page  260. 


31.13  Theorem. 

Notation  and  hypotheses  are  as  in  Theorem  31.12,  except  we  set 

=  3sup{|/"Q)|  :i6J} 

2inf{|/'(x)| 

and  we  consider  distinct  xq  and  x\  in  I  satisfying 


max{|/(x0)|,  |/(xi)|}  <  mS. 

As  before  5  >  0  is  chosen  so  the  25  <  do  and  C5  <  1. 

The  sequence  ( xn )  of  iterates  given  by  the  secant  method, 

f(xn—  1 )  (Xn— 2  Xn—  i) 


%n  —  %n—  1 


for  n  >  2, 


f{xn-2)  -  f{xn- 1) 
is  well  defined  and  converges  to  x.  Also, 

\xn  —  x\  <  C  ■  max{|xn_i  —  x\,  \xn-2  —  x\}2  for  all  n>  2, 
and  for  n  >  0,  we  have 


(1) 

(2) 

(3) 


max{|x2n  —  x\,  \x2n+i  -  x\}  <  (Cd)2"  1  max{|x0  -  x\,  |xi  -  x|}.  (4) 


Proof 

As  in  Discussion  31.11,  (1)  implies 

max{|xo  —  x\,  |xi  —  x|}  <  d.  (5) 


Since 


f(xn-i)(xn-2  -  Xn-l) 

f(xn-2 )  -  f{xn- 1) 


Xn  -  X  =  xn-i  -  x  - 


for  n  >  2 
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the  Mean  Value  Theorem  shows  there  is  wn  between  xn-\  and  xn-2 
so  that 


xn  -  x  =  xn-i  -x- 


/Qn- 1) 

/'On)  ’ 


By  Taylor’s  Theorem  31.3  on  page  250,  with  n  =  2,  c  =  x  and 
x  =  xn-i,  we  have 


1 


— \2 


/On- 1)  =  / 0)  +  /  (0  ’  On- 1  -  *)  +  o/  On)  ’  On-1  ~  z) 


=  /'0)  •  On-1  -  X)  +  ^/"Oi)  •  On-1  -  X)* 2 
for  some  yn  between  xn-\  and  x.  Hence 

_  ,  _x  /'  0)  •  (xn- 1  -  x)  +  /"(yn )  •  On-1 

/'On 


x)2/2 


_  Qn-1  -  x)f(wn)  ~  /' Q)  •  Qn— 1  ~  T)  -  /"Qn)  ~  (^n-1  ~  Q)2/2 

/'On) 

Xn_l-T(  ,  ,  /"On)  •  On-1  -T)] 

=  7w"l  («>»)-/(*)] - i - }■ 

By  the  Mean  Value  Theorem,  applied  to  /',  we  obtain 

_  xn-\  —x  J  /"On)  ■  On-i  -x)  \ 

Xn~X=  U  (Zn)-(wn-x) - - - |  (6) 

for  some  zn  between  wn  and  x. 

In  general,  a  <  c  <b  implies  |c  —  x\  <  max{|a  —  x|,  \b  —  x|}  for  all 
x  in  M  [Exercise  31.12].  Applying  this,  with  a  =  min{xn-i, xn-2}, 
b  =  max{i„_i,s„-2},  c  =  wn  and  x  =  x,  we  obtain 

On  -  x\  <  max{|x„_i  -  x\,  \xn-2  -  x|}. 

Using  this  and  (6),  above  we  conclude 

,  .  3sup{/"0)  :  x  G  J}  2 

\xn  ~x\<  -  .  - — — j-  max{  Xn-i  -  x\,  x„_2  -  x  }  , 

2  mt{/'p)  :  x  E 

so  that  (3)  holds.  Substituting  an  =  \xn  —  x\  into  (3)  and  (5),  we  see 
that  Lemma  31.10(b)  implies  the  inequalities  in  (4).  Inequalities  (4) 
and  (5)  imply  \xn  —  xq\  <  2d  for  all  n,  so  each  xn  is  in  J,  as  needed 
for  the  preceding  argument.  This  completes  the  proof.  ■ 
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Exercises 

31.1  Find  the  Taylor  series  for  cosx  and  indicate  why  it  converges  to  cos  a; 
for  all  x  £  R. 

31.2  Repeat  Exercise  31.1  for  the  functions  sinha;  =  \{ex  —  e~x )  and 
cosha:  =  |( ex  +  e~x). 

31.3  In  Example  2,  why  did  we  apply  Theorem  31.3  instead  of  Corol¬ 
lary  31.4? 

31.4  Consider  a,b  in  R  where  a  <  b.  Show  there  exist  infinitely  dif¬ 
ferentiable  functions  fa ,  gb,  and  h*ab  on  M  with  the  following 
properties.  You  may  assume,  without  proof,  that  the  sum,  product, 
etc.  of  infinitely  differentiable  functions  is  again  infinitely  differen¬ 
tiable.  The  same  applies  to  the  quotient  provided  the  denominator 
never  vanishes. 

(a)  fa(x )  =  0  for  x  <  a  and  fa(x)  >  0  for  x  >  a.  Hint:  Let  fa(x)  = 
/( x  —  a)  where  /  is  the  function  in  Example  3. 

(b)  gb(x)  =  0  for  x  >  b  and  gb(x)  >  0  for  x  <  b. 

(c)  ha,b(x)  >  0  for  x  G  (a,  b)  and  ha,b(x)  =  0  for  x  £  (a,  b). 

(d)  h*  b(x)  =  0  for  x  <  a  and  h*  b(x)  =  1  for  x  >  b.  Hint:  Use  the 
function  -r^f — . 

fa+gb 

31.5  Let  g(x)  =  e_1/x2  for  x  ^  0  and  g{ 0)  =  0. 

(a)  Show  g(jl\ 0)  =  0  for  all  n  =  0, 1,2,  3, . . ..  Hint:  Use  Example  3. 

(b)  Show  the  Taylor  series  for  g  about  0  agrees  with  g  only  at  x  =  0. 

31.6  An  older  proof  of  Theorem  31.3  goes  as  follows,  which  we  outline  for 
c  =  0.  Assume  x  >  0,  let  M  be  as  in  the  proof  of  Theorem  31.3,  and 
let 

m = m + i; 

fc= i 

for  t  in  [0, a;]. 

(a)  Show  F  is  differentiable  on  [0,  x\  and 
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(b)  Show  F( 0)  =  F( x). 

(c)  Apply  Rolle’s  Theorem  29.2  to  F  to  obtain  y  in  (0,  x)  such  that 


31.7  Show  the  sequence  in  Exercise  9.5  comes  from  Newton’s  method  when 
solving  /( x)  =  x2  —  2  =  0. 

31.8  (a)  Show  x4  +  xa  —  1  =  0  has  exactly  two  solutions. 

(b)  Use  Newton’s  method  or  the  secant  method  to  find  the  solutions 
to  x4  +  x3  —  1  =  0  to  six-place  accuracy. 


31.9  Exercise  18.6  asked  for  a  proof  that  x  =  cosx  for  some  x  in  (0,  f ). 
Use  Newton’s  method  to  find  x  to  six-place  accuracy.  Hint :  Apply 
Newton’s  method  to  f(x)  =  x  —  cosx. 

31.10  Exercise  18.7  asked  for  a  proof  that  xex  =  2  for  some  x  in  (0, 1).  Use 
Newton’s  method  to  find  x  to  six-place  accuracy. 


31.11  Suppose  /  is  differentiable  on  (a,  b ),  /'  is  bounded  on  (a,  b),  f  never 
vanishes  on  (a,  b)1  and  the  sequence  (xn)  in  (a,  b)  converges  to  x  in 
(a,  b).  Show  that  if 


%n  —  %n—  1 


f{Xn- l) 

1) 


for  all  n  >  1, 


then  f(x)  =  0. 


31.12  This  result  will  complete  the  proof  of  Theorem  31.13.  Show  that  if 
a  <  c  <  6,  then  \c  —  x\  <  max{|a  —  x\,  \b  —  x\}  for  all  itl.  Hint : 
Consider  two  cases:  x  <  c  and  x  >  c. 
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CHAPTER 


This  chapter  serves  two  purposes.  It  contains  a  careful  development 
of  the  Riemann  integral,  which  is  the  integral  studied  in  standard 
calculus  courses.  It  also  contains  an  introduction  to  a  generalization 
of  the  Riemann  integral  called  the  Riemann-Stieltjes  integral.  The 
generalization  is  easy  and  natural.  Moreover,  the  Riemann-Stieltjes 
integral  is  an  important  tool  in  probability  and  statistics,  and  other 
areas  of  mathematics. 

§32  The  Riemann  Integral 

The  theory  of  the  Riemann  integral  is  no  more  difficult  than  several 
other  topics  dealt  with  in  this  book.  The  one  drawback  is  that  it 
involves  some  technical  notation  and  terminology. 

32.1  Definition. 

Let  /  be  a  bounded  function  on  a  closed  interval  [a,  b]  .1  For  S  C  [a,  b], 
we  adopt  the  notation 


1Hcre  and  elsewhere  in  this  chapter,  we  assume  a  <  b. 
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M(f,S)  =  sup {/(x)  :  x  €  S}  and  m(f,S)  =  inf{/(x)  :  x  G  5}. 
A  partition  of  [a,  b]  is  any  finite  ordered  subset  P  having  the  form 
P  =  {a  =  to  <  h  <  ■  ■  ■  <  tn  =  b}. 

The  upper  Darboux  sum  U (/,  P)  of  /  with  respect  to  P  is  the  sum 

n 

U(f,  P)  =  J2  M(4  [4-i,4])  •  (4  -  4-i) 

fc=i 

and  the  lower  Darboux  sum  L(f,  P )  is 

n 

L{f,P)  =  ^  m(-4  [4-i,4])  •  (4  -  4-i )• 

fc=i 

Note 

n 

U(f,P)  [ a,b ])  •  (4  -  4-1 )  =  M(f,  [ a,b ])  •  (6-  a); 

fc=i 

likewise  L(f,  P)  >  m(f,  [a,  b\)  ■  (b  —  a),  so 

m(f,  [a,  6])  ■  (6-a)  <  L(/,P)  <  U(f,P)  <  M(f,  [ a,b ])  •  (6 -a).  (1) 
The  upper  Darboux  integral  U (/)  of  /  over  [a,  6]  is  defined  by 
£/(/)  =  inf {[/(/,  P)  :  P  is  a  partition  of  [a,  6]} 
and  the  lower  Darboux  integral  is 

L{f)  =  sup{L(/, P)  :  P  is  a  partition  of  [a, b]}. 

In  view  of  (1),  U(f)  and  L(f)  are  real  numbers. 

We  will  prove  in  Theorem  32.4  that  L(f)  <  U(f).  This  is  not 
obvious  from  (1).  [Why?]  We  say  /  is  integrable  on  [a,  b]  provided 
L(f)  =  U(f).  In  this  case,  we  write  f’’  f  or  j^f(x)dx  for  this 
common  value: 

[bf=  f  f(x)dx  =  L(f)  =  U(f).  (2) 

J  a  J  a 

Specialists  call  this  integral  the  Darboux  integral.  Riemann’s  def¬ 
inition  of  the  integral  is  a  little  different  [Definition  32.8],  but  we  will 
show  in  Theorem  32.9  that  the  definitions  are  equivalent.  For  this 


§32.  The  Riemann  Integral  271 


FIGURE  32.1 


reason,  we  will  follow  customary  usage  and  call  the  integral  defined 
above  the  Riemann  integral. 

For  nonnegative  functions,  f  is  interpreted  as  the  area  of  the 
region  under  the  graph  of  /  [see  Fig.  32.1]  for  the  following  reason. 
Each  lower  Darboux  sum  represents  the  area  of  a  union  of  rectangles 
inside  the  region,  and  each  upper  Darboux  sum  represents  the  area  of 
a  union  of  rectangles  that  contains  the  region.  Moreover,  f f  is  the 
unique  number  that  is  larger  than  or  equal  to  all  lower  Darboux  sums 
and  smaller  than  or  equal  to  all  upper  Darboux  sums.  Figure  19.2 
on  page  145  illustrates  the  situation  for  [a,b]  =  [0, 1]  and 


P  = 


1  2 

0  <  -  <  -  < 
n  n 


< 


n  —  1 
n 


Example  1 

The  simplest  function  whose  integral  is  not  obvious  is  f(x)  =  x2. 
Consider  /  on  the  interval  [0,  b]  where  b  >  0.  For  a  partition 

P  =  {0  =  t0  <  ti  <  •  •  •  <  tn  =  6}, 


we  have 


U(f,P)  =  ^>p{*2  :  x  G  [tk-i,tk]}-(tk~tk-i)  =  'y]tl(tk-tk-i). 

k= 1  k= 1 
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If  we  choose  ti,  =  — ,  then  we  can  use  Exercise  1.1  to  calculate 

ft,  n  7 


£/(/,P) 


n 


E 


2^2 


kZb 


r 


hl 

n3 


n 


Efc2 


63  n(n  +  l)(2n  +  1) 
n3  6 


For  large  n,  this  is  close  to  y,  so  we  conclude  U(f )  <  y.  For  the 
same  partition  we  find 

(fc  -  1  )262 


b3 


L(f,P)  = 


n 

E 

fc=i 


63  (n  —  l)(n)(2n  —  1) 


so  L(f )  >  y.  Therefore  /(x)  =  x 2  is  integrable  on  [0,6]  and 


63 

3  ' 


Of  course,  any  calculus  student  could  have  calculated  this  inte¬ 
gral  using  a  formula  that  is  based  on  the  Fundamental  Theorem  of 
Calculus;  see  Example  1  in  §34.  □ 


Example  2 

Consider  the  interval  [a,  6],  where  a  <  6,  and  let  /(x)  =  1  for  rational 
x  in  [a,  6],  and  let  /(x)  =  0  for  irrational  x  in  [a,  6],  For  any  partition 

P  =  {a  =  t0  <  h  <  ■  ■  ■  <  tn  =  b}, 


we  have 

n  n 

U(f,P )  =  [4-1,4]) •  (4  ~4-i)  =  ^  l-(4-4-i)  =  b-a 

k=  1  k= 1 

and 

n 

L(f ,  p) = o  •  (4  -  4-i)  =  o. 

k=  1 

It  follows  that  17(/)  =  6  —  a  and  L(f)  =  0.  The  upper  and  lower 
Darboux  integrals  for  /  do  not  agree,  so  /  is  not  integrable!  □ 


We  next  develop  some  properties  of  the  integral. 
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32.2  Lemma. 

Let  f  be  a  bounded  function  on  [a,  b\.  If  P  and  Q  are  partitions  of 
[a,  b }  and  P  C  Q,  then 

L(f,  P)  <  L(f,  Q)  <  U(f,  Q)  <  U(f,  P ).  (1) 

Proof 

The  middle  inequality  is  obvious.  The  proofs  of  the  first  and  third 
inequalities  are  similar,  so  we  will  prove 

L(f,  P)  <  L(f,  Q).  (2) 

An  induction  argument  [Exercise  32.4]  shows  we  may  assume 
Q  has  only  one  more  point,  say  u,  than  P.  If 

P  =  {a  =  t0  <  h  <  ■  ■  ■  <  tn  =  b}, 

then 


Q  =  {a  =  t0  <  ti  <■■■  <  tk-i  <  u  <  tk  <  ■  ■  ■  <  tn  =  b} 

for  some  k  £  {1,  2, . . .  ,n}.  The  lower  Darboux  sums  for  P  and  Q 
are  the  same  except  for  the  terms  involving  tk- 1  or  tk-  In  fact,  their 
difference  is 

L(f,  Q)  -  L(f,  P )  =  m(f,  [tk- i,  u])-{u-  tk- i)  +  m(f,  [u,  tk ])  •  ( tk  -  u) 

-m(/,  [tk-i,tk])  ■  (ife  -  bc_i).  (3) 


To  establish  (2)  it  suffices  to  show  this  quantity  is  nonnegative.  Using 
Exercise  4.7(a),  we  see 

i  [tk—  1)  tk ])  '  ( fk  tk— l) 

=  ra(/,  [4-i,4])  •  {(4  -u)  +  (u-  4-i)} 

<  rn(f,  [u,4])  •  (4  -  u)  +  m(f,  [tk-i,u])  ■  ( u  -  4-i)-  H 


32.3  Lemma. 

If  f  is  a  bounded  function  on  [a,  61 ,  and  if  P  and  Q  are  partitions  of 
[a,  6]  ,  then  L(f ,  P)  <  U(f,Q). 

Proof 

The  set  P  U  Q  is  also  a  partition  of  [a,  b].  Since  P  C  P  U  Q  and 
Q  C  P  U  Q,  we  can  apply  Lemma  32.2  to  obtain 

L(f,  P)  <  L(f,  PUQ)<  U(f,  PUQ)<  U(f,  Q ). 
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32.4  Theorem. 

If  f  is  a  bounded  function  on  [a,b\,  then  L(f)  <  U(f). 

Proof 

Fix  a  partition  P  of  [a,b\.  Lemma  32.3  shows  L(f,P)  is  a  lower 
bound  for  the  set 

{[/(/,  Q)  :  Q  is  a  partition  of  [a,  6]}. 

Therefore  L(f,P)  is  less  than  or  equal  to  the  greatest  lower  bound 
[infimum!]  of  this  set.  That  is 

L(f,P)<U(f).  (1) 

Now  (1)  shows  that  U(f)  is  an  upper  bound  for  the  set 

{L(f,  P)  :  P  is  a  partition  of  [a,  b}}, 

so  [/(/)  >  L(f).  m 


Note  that  Theorem  32.4  also  follows  from  Lemma  32.3  and  Ex¬ 
ercise  4.8;  see  Exercise  32.5.  The  next  theorem  gives  a  “Cauchy 
criterion”  for  integrability. 


32.5  Theorem. 

A  bounded  function  f  on  [a,  b]  is  integrable  if  and  only  if  for  each 
e  >  0  there  exists  a  partition  P  of  [a,  b]  such  that 

U(f,P)  —  L(f,P)  <  e.  (1) 

Proof 

Suppose  first  that  /  is  integrable  and  consider  e  >  0.  There  exist 
partitions  Pi  and  P2  of  [a,  b]  satisfying 

L(/,Pi)>L(/)-|  and  U(f,P2)<U(f)  +  ^. 

For  P  =  Pi  U  P2,  we  apply  Lemma  32.2  to  obtain 


u(f,  p)  -  L(f,  p)  <  u(f,  p2)  -  Uf  Pn 


<  U(f)  +  2 


m  -  -2l 


Since  /  is  integrable,  U(f)  =  L(f),  so  (1)  holds. 
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Conversely,  suppose  for  e  >  0  the  inequality  (1)  holds  for  some 
partition  P.  Then  we  have 

U(f)  <  U(f,  P )  =  U(f,  P)  -  L(f,  P )  +  L(f,  P) 

<  6  +  L(f,P)  <  e  +  L(f). 

Since  e  is  arbitrary,  we  conclude  U (/)  <  L(f).  Hence  we  have  U (/)  = 
L(f)  by  Theorem  32.4,  i.e.,  /  is  integrable.  ■ 

The  remainder  of  this  section  is  devoted  to  establishing  the 
equivalence  of  Riemann’s  and  Darboux’s  definitions  of  integrabil- 
ity.  Subsequent  sections  will  depend  only  on  items  Definition  32.1 
through  Theorem  32.5.  Therefore  the  reader  who  is  content  with  the 
Darboux  integral  in  Definition  32.1  can  safely  proceed  directly  to  the 
next  section. 

32.6  Definition. 

The  mesh  of  a  partition  P  is  the  maximum  length  of  the  subintervals 
comprising  P.  Thus  if 

P  =  {a  =  t0  <  h  <  ■  ■  ■  <  tn  =  b}, 

then 

mesh(P)  =  maxjtfc  —  tk- i  :  k  =  1, 2, . . . ,  n}. 


Here  is  another  “Cauchy  criterion”  for  integrability. 

32.7  Theorem. 

A  bounded  function  f  on  [a,  b]  is  integrable  if  and  only  if  for  each 
e  >  0  there  exists  a  5  >  0  such  that 

rnesh(P)  <  5  implies  U(f,P)  —  L(f,P)  <  e  (1) 

for  all  partitions  P  of  [a,  b] . 

Proof 

The  e—5  condition  in  (1)  implies  integrability  by  Theorem  32.5. 

Conversely,  suppose  /  is  integrable  on  [a,  b\.  Let  e  >  0  and  select 
a  partition 

Po  =  {a  =  uq  <  u\  <■■■<  um  =  b} 


276  ®-  Integration 


of  [a,  b]  such  that 

P(/,P0)-L(/,P0)<|.  (2) 

Since  /  is  bounded,  there  exists  B  >  0  such  that  \f(x)\  <  B  for  all 
x  £  [a,b\.  Let  5  =  the  number  of  intervals  comprising  Pq. 

To  verify  (1),  we  consider  any  partition 

P  =  {a  =  to  <  t\  <■■■<  tn  =  b} 

with  mesh(P)  <  6.  Let  Q  =  P  U  Pq.  If  Q  has  one  more  element 
than  P,  then  a  glance  at  (3)  in  the  proof  of  Lemma  32.2  leads  us  to 

L(f,  Q)  —  L(f,  P)  <  B  ■  mesh(P)  —  (— B)  ■  mesh(P)  =  2 B  ■  mesh(P). 

Since  Q  has  at  most  m  elements  that  are  not  in  P,  an  induction 
argument  shows 

L(f,  Q )  -  L(/,  P)  <  2 mB  ■  mesh (P)  <  2 mBS  = 

By  Lemma  32.2  we  have  L(f ,  Pq)  <  L(f,  Q ),  so 
L(f,Po)  —  L(f,P)  < 

Similarly 

U(f,  P)  —  U(f,Po)  < 

so 

U(f,  P)  -  L(f,  P )  <  U(f,  P0)  -  L(f ,  P0)  +  e~. 

Now  (2)  implies  U(f ,  P)  —  L(f ,  P)  <  e  and  we  have  verified  (1).  ■ 

Now  we  give  Riemann’s  definition  of  integrability. 

32.8  Definition. 

Let  /  be  a  bounded  function  on  [o, b],  and  let  P  =  {a  =  to  <  t\  < 
•  •  •  <  tn  =  b}  be  a  partition  of  [a,  b].  A  Riemann  sum  of  /  associated 
with  the  partition  P  is  a  sum  of  the  form 

n 

f(xk)(tk  -  tk~  i) 

k= 1 
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where  xk  £  [tk-i,tk]  for  k  =  1,  2, . . . ,  n.  The  choice  of  xks  is  quite 
arbitrary,  so  there  are  infinitely  many  Riemann  sums  associated  with 
a  single  function  and  partition. 

The  function  /  is  Riemann  integrable  on  [a,  b]  if  there  exists  a 
number  r  with  the  following  property.  For  each  e  >  0  there  exists 
5  >  0  such  that 


\S  —  r\  <  e  (1) 

for  every  Riemann  sum  S'  of  /  associated  with  a  partition  P  having 
mesh(P)  <  5.  The  number  r  is  the  Riemann  integral  of  /  on  [a,  b] 
and  will  be  provisionally  written  as  1Z  f. 


32.9  Theorem. 

A  bounded  function  f  on  [a,  b]  is  Riemann  integrable  if  and  only  if 
it  is  [ Darboux ]  integrable,  in  which  case  the  values  of  the  integrals 
agree. 


Proof 

Suppose  first  that  /  is  [Darboux]  integrable  on  [a,  b]  in  the  sense  of 
Definition  32.1.  Let  e  >  0,  and  let  <5  >  0  be  chosen  so  that  (1)  of 
Theorem  32.7  holds.  We  show 


S 


<  e 


(1) 


for  every  Riemann  sum 


S  =  y^f(xk)(tk  -  4_i) 

fc=i 


associated  with  a  partition  P  having  mesh(P)  <  6.  Clearly  we  have 
L(f,P)  <  S  <  U(f,P),  so  (1)  follows  from  the  inequalities 


and 


U{f,P)  <  L(f,P)  +  e<  L(f)  +  e 


f  +  e 


—  e. 


L(f,P)  >  U(f,P)  —  e>  U(f)  —  e  = 
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This  proves  (1);  hence  /  is  Riemann  integrable  and 


Now  suppose  /  is  Riemann  integrable  in  the  sense  of  Defini¬ 
tion  32.8,  and  consider  e  >  0.  Let  5  >  0  and  r  be  as  given  in 
Definition  32.8.  Select  any  partition 


P  =  {a  =  to  <  t\  <■■■<  tn  =  b} 


with  mesh(T’)  <  5,  and  for  each  k  =  1,  2, . . . ,  n,  select  Xk  in  [4-i,  4] 
so  that 

f(xk )  <  m{f ,  [4_i,tfc])  +  e. 

The  Riemann  sum  S  for  this  choice  of  x^s  satisfies 

S<L(f,P)  +  e(b-a) 

as  well  as 


| S'  —  r\  <  e. 


It  follows  that 


L(f)  >  L(f ,  P)  >  S  —  e(b  —  a)  >  r  —  e  —  e(b  —  a). 

Since  e  is  arbitrary,  we  have  L(f)  >  r.  A  similar  argument  shows 
U(f)  <  r.  Since  L(f )  <  U(f),  we  see  L(f)  =  [/(/)=  r.  This  shows 
/  is  [Darboux]  integrable  and 


32.10  Corollary. 

Let  f  be  a  bounded  Riemann  integrable  function  on  [a,  b] .  Suppose 
(. Sn )  is  a  sequence  of  Riemann  sums,  with  corresponding  partitions 
Pn,  satisfying  limnmesh(Pn)  =  0.  Then  the  sequence  (. Sn )  converges 
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Proof 

Let  e  >  0.  There  is  a  5  >  0  so  that  if  S'  is  a  Riemann  sum  with 
corresponding  partition  P,  and  if  mesh(P)  <  5 ,  then 


Choose  N  so  that  mesh(Pn)  <  <5  for  n  >  N.  Then 
Sn  —  <  e  for  n  >  N. 


Since  e  >  0  is  arbitrary,  this  shows  limn  Sn  =  f(’  f . 


32.11  Remark. 

I  recently  had  occasion  to  use  the  following  simple  observation.  If 
one  ignores  the  end  intervals  of  the  partitions,  the  “almost  Riemann 
sums”  so  obtained  still  converge  to  the  integral;  see  [59].  This  arose 
because  the  intervals  had  the  form  [a,  6],  but  the  partition  points  had 
the  form  - .  Thus  the  partition  points  were  nice  and  equally  spaced, 
except  for  the  end  ones. 

Exercises 

32.1  Find  the  upper  and  lower  Darboux  integrals  for  f(x)  =  x 3  on  the 
interval  [0,6].  Hint:  Exercise  1.3  and  Example  1  in  §1  will  be  useful. 

32.2  Let  f(x)  =  x  for  rational  x  and  f(x)  =  0  for  irrational  x. 

(a)  Calculate  the  upper  and  lower  Darboux  integrals  for  /  on  the 
interval  [0,6]. 

(b)  Is  /  integrable  on  [0,  6]? 

32.3  Repeat  Exercise  32.2  for  g  where  g{x)  =  x2  for  rational  x  and 
g(x)  =  0  for  irrational  x. 

32.4  Supply  the  induction  argument  needed  in  the  proof  of  Lemma  32.2. 

32.5  Use  Exercise  4.8  to  prove  Theorem  32.4.  Specify  the  sets  S  and  T  in 


this  case. 
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32.6  Let  /  be  a  bounded  function  on  [a,  b\.  Suppose  there  exist  sequences 
(Un)  and  ( Ln )  of  upper  and  lower  Darboux  sums  for  /  such  that 
lim(f/n  —  Ln )  =  0.  Show  /  is  integrable  and  fa  f  =  lim  Un  =  limL„. 

32.7  Let  /  be  integrable  on  [a,  6],  and  suppose  g  is  a  function  on  [a,  6] 
such  that  g(x)  =  f(x)  except  for  finitely  many  x  in  [a,  b\.  Show  g  is 
integrable  and  f  f  =  f  g.  Hint:  First  reduce  to  the  case  where  /  is 
the  function  identically  equal  to  0. 

32.8  Show  that  if  /  is  integrable  on  [a,  b],  then  /  is  integrable  on  every 
interval  [c,  d\  C  [a,  b] . 


§33  Properties  of  the  Riemann  Integral 

In  this  section  we  establish  some  basic  properties  of  the  Riemann 
integral  and  we  show  many  familiar  functions,  including  piece- 
wise  continuous  and  piecewise  monotonic  functions,  are  Riemann 
integrable. 

A  function  is  monotonic  on  an  interval  if  it  is  either  increasing 
or  decreasing  on  the  interval;  see  Definition  29.6. 


33.1  Theorem. 

Every  monotonic  function  f  on  [a,  b]  is  integrable. 


Proof 

We  assume  /  is  increasing  on  [a,  6]  and  leave  the  decreasing  case  to 
Exercise  33.1.  We  also  assume  /(a)  <  f(b ),  since  otherwise  /  would 
be  a  constant  function.  Since  /(a)  <  f(x)  <  f(b )  for  all  x  £  [a,  b], 
f  is  clearly  bounded  on  [a,b\.  In  order  to  apply  Theorem  32.5,  let 
e  >  0  and  select  a  partition  P  =  {a  =  to  <  t\  <■■■<  tn  =  b}  with 


mesh  less  than 


.  Then 


U(f,  P )  -  L(f,  P)  =  [4_ i,  tfc])  -  m(f,  [tk-i,tk])}  ■  (■ tk  -  tk- 0 

k=  1 

n 

=  -  f(tk- 1)]  '  (tk  ~  tk- 1). 

k=  1 
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Since  mesh(P)  <  J(a)i  we  have 


U(f,  P )  -  L(f,  P )  <  ]T[/(4)  -  /(4- 1)]  ' 

k= i 

=  [/(&)  -  /(a)] 


/(6)  -  f(a) 


f{b)  -  /(a) 


=  e. 


Theorem  32.5  now  shows  /  is  integrable. 


33.2  Theorem. 

Every  continuous  function  f  on  [a,  b]  is  integrable. 

Proof 

Again,  in  order  to  apply  Theorem  32.5,  consider  e  >  0.  Since  /  is 
uniformly  continuous  on  [a,  b]  by  Theorem  19.2,  there  exists  8  >  0 
such  that 

x,ye[a,b]  and  \x  -  y\  <  8  imply  \f(x)  -  f(y)\  <  — .  (1) 

b  —  a 

Consider  any  partition  P  =  {a  =  to  <  t\  <■■■<  tn  =  b}  where 

ma x{tk  —  tk~i  ■  k  =  1, 2, . . . ,  n}  <  8. 

Since  /  assumes  its  maximum  and  minimum  on  each  interval 
[th—i,tk]  by  Theorem  18.1,  it  follows  from  (1)  above  that 

M(f,  [4-1,4])  -  rn(f ,  [4_i,4])  <  — ^ — 

o  —  a 

for  each  k.  Therefore  we  have 

n 

U(f,  P)  -  L(f,  P)  <  V  r— fit  -  4-1 1  -  e, 
and  Theorem  32.5  shows  /  is  integrable.  ■ 


33.3  Theorem. 

Let  f  and  g  be  integrable  functions  on  [a,b\,  and  let  c  be  a  real 
number.  Then 

(i)  cf  is  integrable  and  J ^  cf  =  c  /; 

(ii)  f  +  9  is  integrable  and  ]^(f  +  g)  =  f  +  g. 
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Exercise  33.8  shows  fg,  max(/,  g)  and  min(/,  g)  are  also  inte¬ 
gral)  le,  but  there  are  no  formulas  giving  their  integrals  in  terms  of 

fa  f  alld  fa  9- 

Proof 

The  proof  of  (i)  involves  three  cases:  c  >  0,  c  =  —  1,  and  c  <  0.  Of 
course,  (i)  is  obvious  for  c  =  0. 

Let  c  >  0  and  consider  a  partition 

P  =  {a  =  to  <  t\  <■■■<  tn  =  b} 

of  [a,  b\.  A  simple  exercise  [Exercise  33.2]  shows 

M(cf,  [4_1,4])  =  c-M(f,  [tk-i,tk]) 

for  all  k,  so  U(cf,P)  =  c-U(f,P).  Another  application  of  the 
same  exercise  shows  U{cf )  =  c  ■  U(f).  Similar  arguments  show 
L(cf )  =  c  ■  L(f).  Since  /  is  integrable,  we  have  L(cf )  =  c-L(f)  =  c- 
U(f)  =  U(cf).  Hence  cf  is  integrable  and 

f  cf  =  U(cf)  =  c-U(f)  =  c  f  /,  O  0.  (1) 

J  a  J  a 

Now  we  deal  with  the  case  c  =  —1.  Exercise  5.4  implies 
U(—f,P)  =  —L(f,P)  for  all  partitions  P  of  [a,b\.  Hence  we  have 

U(—f )  =  inf {U(—f,P)  :  P  is  a  partition  of  [a, b]} 

=  inf  {—L(f,P)  :  P  is  a  partition  of  [a,  b]} 

=  —  sup {L(f,P)  :  P  is  a  partition  of  [a,  b]}  =  —L(f). 

Replacing  /  by  — /,  we  also  obtain  L(—f )  =  —U(f).  Since  /  is  inte¬ 
grable,  U(—f )  =  —L(f)  =  —U(f)  =  L{— /);  hence  — /  is  integrable 
and 

rb  rb 

/  (-/)  =  -  /  /•  (2) 
J  a  J  a 

The  case  c  <  0  is  handled  by  applying  (2),  and  then  (1)  to  — c: 

rb  rb  rb  rb 

/  cf  =  -  (-c)f  =  -(-c)  /  f  =  c  f. 

J  a  J  a  J  a  J  a 
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To  prove  (ii)  we  will  again  use  Theorem  32.5.  Let  e  >  0.  By 
Theorem  32.5  there  exist  partitions  Pi  and  P2  of  [a,b]  such  that 

t/(/,P1)-L(/,P1)<|  and  U(g,P2)-L(g,P2)<^. 

Lemma  32.2  shows  that  if  P  =  P\  U  P2,  then 

U(f,P)-L(f,P)<  |  and  U(g,P)-L(g,P)< (3) 

For  any  subset  S  of  [ a,b ],  we  have 
inf{/(x)  +  g(x)  :  x  6  5}  >  inf{/(x)  :t£S}  +  inf{g(x)  :  x  £  5}, 
i.e.,  m(f  +  g,  S)  >  m(f,  S )  +  m(g,  S ).  It  follows  that 
L(f  +  g,P)>L(f,P)  +  L(g,P) 
and  similarly  we  have 


U(f  +  g,P)  <U(f,P)  +  U(g,P). 

Therefore  from  (3)  we  obtain 

U(f  +  g,P)-L(f  +  g,P)<e. 

Theorem  32.5  now  shows  /  +  g  is  integrable.  Since 

[  (f  +  9)  =  U{f  +  g)<  U(f  +  g,P)  <  U{f,  P)  +  U{g,  P) 

J  a 

<  L(f ,  P)  +  L(g,  P)  +  e  <  L(f)  +  L(g)  +  e  =  f  f+f  5  +  e 

J  a  J  a 


and 

rb 


[  ( f  +  9)=  L(f  +  g)>  L(f  +  g,P)  >  L(f,  P)  +  L(g ,  P) 

J  a 

>U(f,P)  +  U(g,P)  —  e>  U(f)  +  U(g)  —  e=  f  f  +  [  g  -  e, 

J  a  J  a 


we  see  that 
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33.4  Theorem. 

(i)  If  f  and  g  are  integrable  on  [a,b\  and  if  f(x)  <  g(x)  for  x  in 

ML  then  fbf<  fbag. 

(ii)  If  g  is  a  continuous  nonnegative  function  on  [a,  b\  and  if 
fb  g  =  0,  then  g  is  identically  0  on  [ a,b\ . 


Proof 

(i)  By  Theorem  33.3,  h  =  g  —  f  is  integrable  on  [a,  b\.  Since 
h(x)  >  0  for  all  x  6  [a,  b],  it  is  clear  that  L(h,P)  >  0  for 
all  partitions  P  of  [a,  b],  so  fbh  =  L(h)  >  0.  Applying 
Theorem  33.3  again,  we  see 


/• 


(ii)  Otherwise,  since  g  is  continuous,  there  is  a  nonempty  interval 
(c,d)  C  [a,b\  and  a  >  0  satisfying  g(x)  >  a/2  for  x  €  (c,d). 
Then 

j\>j\>^(d-c)>  0, 

contradicting  fbg  =  0.  ■ 


33.5  Theorem. 

If  f  is  integrable  on  [a,b\,  then  \  f\  is  integrable  on  [a,b\  and 


(1) 


Proof 

This  follows  easily  from  Theorem  33. 4 (i)  provided  we  know  |/|  is 
integrable  on  [a,  b\.  In  fact,  —\f  \  <  f  <  |/|;  therefore 

rb  rb  rb 

-  I/I  <  /  /<  /  I/I, 

J  a  J  a  J  a 

which  implies  (1). 

We  now  show  |/|  is  integrable,  a  point  that  was  conveniently 
glossed  over  in  Exercise  25.1.  For  any  subset  S  of  [a,  b],  we  have 


M(\fl  S)  -  m(|/|,  5)  <  M(f,  S )  -  m(f,  S ) 


(2) 


§33.  Properties  of  the  Riemann  Integral  285 


by  Exercise  33.6.  From  (2)  it  follows  that 

U{\f\,P)  -  L(\f\,P)  <  U(f,P)  —  L(f,  P)  (3) 

for  all  partitions  P  of  [ a,b\ .  By  Theorem  32.5,  for  each  e  >  0  there 
exists  a  partition  P  such  that 

U(f,P)  —  L(f,P)  <  e. 

In  view  of  (3),  the  same  remark  applies  to  |/|,  so  |/|  is  integrable  by 
Theorem  32.5.  ■ 

33.6  Theorem. 

Let  f  be  a  function  defined  on  [a,  b].  If  a  <  c  <  b  and  f  is  integrable 
on  [ a,c\  and  on  [ c,b\ ,  then  f  is  integrable  on  [a,b\  and 

rb  rc  rb 

f=  /  /  +  /  /■  (i) 

J  a  J  a  J  c 

Proof 

Since  /  is  bounded  on  both  [a,  c]  and  [c,  b ],  /  is  bounded  on  [a,  b].  In 
this  proof  we  will  decorate  upper  and  lower  sums  so  that  it  will  be 
clear  which  intervals  we  are  dealing  with.  Let  e  >  0.  By  Theorem  32.5 
there  exist  partitions  Pi  and  P2  of  [a,  c]  and  [c,  b]  such  that 

Uca(f,P1)-Lca(f,P1)<(2  and  Ubc(f,P2)~Lbc(f,P2)<e-. 

The  set  P  =  Pi  U  P2  is  a  partition  of  [a,  b],  and  it  is  obvious  that 

Ub(fiP)  =  Uca(f,Pi)  +  Ub(f,P2 )  (2) 

with  a  similar  identity  for  lower  sums.  It  follows  that 
Ub(f,P)~Lba(f,P)<e , 

so  /  is  integrable  on  [a,  b]  by  Theorem  32.5.  Also  (1)  holds  because 

[b  f  <  ub(f ,  p)  =  pac(/,  Pi)  +  ub(f ,  p2) 

J  a 

<  Lca(fi  Pi)  +  Lb(f,  P2)  +  e  <  f /+  [ b  f  +  e 

J  a  J  C 


and  similarly  jb  f  >  £  f  +  [b  f  -  e. 
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Most  functions  encountered  in  calculus  and  analysis  are  covered 
by  the  next  definition.  However,  see  Exercises  33.10-33.12. 

33.7  Definition. 

A  function  /  on  [a,  6]  is  piecewise  monotonic  if  there  is  a  partition 
P  =  {a  =  to  <  t\  <■■■<  tn  =  b} 

of  [a,  b]  such  that  /  is  monotonic  on  each  interval  (4-1,4)-  The 
function  /  is  piecewise  continuous  if  there  is  a  partition  P  of  [a,  b] 
such  that  /  is  uniformly  continuous  on  each  interval  (4-i,4)- 

33.8  Theorem. 

If  f  is  a  piecewise  continuous  function  or  a  bounded  piecewise 
monotonic  function  on  [a,  6],  then  f  is  integrable  on  [a,b\. 

Proof 

Let  P  be  the  partition  described  in  Definition  33.7.  Consider  a  fixed 
interval  [4-i,4]-  If  /  is  piecewise  continuous,  then  its  restriction  to 
(4-1,4)  can  be  extended  to  a  continuous  function  4  on  [4-i,4] 
by  Theorem  19.5.  If  /  is  piecewise  monotonic,  then  its  restriction  to 
(4-1,4)  can  be  extended  to  a  monotonic  function  4  on  [4-i,4]> 
for  example,  if  /  is  increasing  on  (4-1,4),  simply  define 

4(4)  =  sup {f(x)  :  x  £  (4-1,4)} 


and 


4(4-i)  =  inf{/(x)  :  x  6  (4_i,4)}. 

In  either  case,  4  is  integrable  on  [4-1,4]  by  Theorem  33.1  or  33.2. 

Since  /  agrees  with  4  on  [4 _ l » 4]  except  possibly  at  the  endpoints, 

Exercise  32.7  shows  /  is  also  integrable  on  [4— 1,4]-  Now  Theo¬ 
rem  33.6  and  a  trivial  induction  argument  show  /  is  integrable  on 
[a,b\.  m 


We  close  this  section  with  a  simple  but  useful  result. 
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33.9  Intermediate  Value  Theorem  for  Integrals. 

If  f  is  a  continuous  function  on  [a,b],  then  for  at  least  one  x  in  (a,b) 
we  have 


Proof 

Let  M  and  m  be  the  maximum  and  minimum  values  of  /  on  [a,b]. 
If  m  =  M,  then  /  is  a  constant  function  and  f(x)  =  f  for 

all  x  G  [a,  6].  Otherwise,  m  <  M  and  by  Theorem  18.1,  there  exist 
distinct  xo  and  "ijq  in  [a,  b]  satisfying  f(x o)  =  m  and  f(yo)  =  M.  Since 
each  function  M  —  f  and  /  —  m  is  nonnegative  and  not  identically  0, 
Theorem  33.4(h)  shows  f  <  M.  Thus 

1  fb 

m  <  - -  /  /  <  M, 

b~a  Ja 

and  by  the  Intermediate  Value  Theorem  18.2  for  continuous  func¬ 
tions,  we  have  f(x)  =  5^  J /  for  some  x  between  xo  and  yo-  Since 
x  is  in  (a,  b),  this  completes  the  proof.  ■ 

33.10  Discussion. 

An  important  question  concerns  when  one  can  interchange  limits  and 
integrals,  i.e. ,  when  is 

rb  rb 

lim  /  fn(x)dx=  /  lim  fn{x)dx  (1) 

n->oo  Ja  Ja  n—>oo 

true?  By  Theorems  24.3  and  25.2,  if  the  fn s  are  continuous  and 
converge  uniformly  to  /  =  linij^oo  fn  on  [a,  6],  then  /  is  continuous 
and  (1)  holds.  It  turns  out  that  if  each  fn  is  just  Riemann  integrable 
and  fn  — y  f  uniformly,  then  /  is  Riemann  integrable  and  (1)  holds; 
see  Exercise  33.9.  What  happens  if  fn  — >  ./’  pointwise  on  [a,b]7  One 
problem  is  that  /  need  not  be  integrable  even  if  it  is  bounded  and 
each  fn  is  integrable. 

Consider,  for  example,  the  non-integrable  function  /  in  Exam¬ 
ple  2  on  page  272:  f(x)  =  1  for  rational  x  in  [a,  b]  and  f(x)  =  0  for 
irrational  x  in  [a,  6].  Let  (xk)k£N  be  an  enumeration  of  the  rationals 
in  [a,  b\,  and  define  fn{xk)  =  1  for  1  <  k  <  n  and  fn{x)  =  0  for 
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all  other  x  in  [a,  b\.  Then  /n  — >  /  pointwise  on  [a,b\,  and  each  fn  is 
integrable. 

This  example  leaves  open  the  possibility  that  (1)  will  hold  pro¬ 
vided  all  the  functions  fn  and  the  limit  function  /  are  integrable. 
However,  Exercise  33.15  provides  an  example  of  a  sequence  (fn)  of 
functions  on  [0, 1]  converging  pointwise  to  a  function  /,  with  all  the 
functions  integrable,  and  yet  (1)  does  not  hold.  Nevertheless,  there 
is  an  important  theorem  that  does  apply  to  sequences  of  functions 
that  converge  pointwise.  □ 

33.11  Dominated  Convergence  Theorem. 

Suppose  (fn)  is  a  sequence  of  integrable  functions  on  [a,  b]  and  fn  — > 
f  pointwise  where  f  is  an  integrable  function  on  [a,  b\.  If  there  exists 
an  M  >  0  such  that  \fn(x)\  <  M  for  all  n  and  all  x  in  [a,  6],  then 


We  omit  the  proof.  An  elementary  proof  of  the  Dominated  Con¬ 
vergence  Theorem  is  given  by  Jonathan  W.  Lewin  [42].  Here  is  a 
corollary. 

33.12  Monotone  Convergence  Theorem. 

Suppose  (fn)  is  a  sequence  of  integrable  functions  on  [a,  b]  such  that 
fi(x)  <  fi(x)  <  •••  for  all  x  in  [a,b\.  Suppose  also  that  fn  — >  / 
pointwise  where  f  is  an  integrable  function  on  [a,  b] .  Then 


This  follows  from  the  Dominated  Convergence  Theorem,  because 
there  exists  an  M  >  0  such  that  |/i(a;)|  <  M  and  also  |/(x)|  <  M 
for  all  x  in  [a,  b\.  This  implies  \  fn(x)\  <  M  for  all  n  and  all  x  in  [a,  6], 
since  —M<f\(x)<  fn(x)  <  M  for  all  x. 

Our  version  of  the  Dominated  Convergence  Theorem  is  a  spe¬ 
cial  case  of  a  much  more  general  theorem,  which  is  usually  stated 
and  proved  for  the  family  of  all  “Lebesgue  integrable  functions,” 
not  just  for  Riemann  integrable  functions.  There  is  also  a  Monotone 
Convergence  Theorem  for  Lebesgue  integrable  functions,  but  in  that 
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generality  it  does  not  follow  immediately  from  the  Dominated  Con¬ 
vergence  Theorem,  because  in  that  setting  integrable  functions  need 
not  be  bounded.  An  elementary  proof  of  the  Monotone  Convergence 
Theorem  is  proved  for  Riemann  integrable  functions,  without  resort 
to  Lebesgue  theory,  by  Brian  S.  Thomson  [67]. 


Exercises 

33.1  Complete  the  proof  of  Theorem  33.1  by  showing  that  a  decreasing 
function  on  [o,  b\  is  integrable. 

33.2  This  exercise  could  have  appeared  just  as  easily  in  §4.  Let  S  be  a 
nonempty  bounded  subset  of  K.  For  fixed  c  >  0,  let  cS  =  {cs  :  s  £  S}. 
Show  sup(cS')  =  c  •  sup(S)  and  inf(c5)  =  c  •  inf  (S'). 

33.3  A  function  /  on  [a,  b]  is  called  a  step  function  if  there  exists  a  partition 

P  =  {o  =  uq  <  u\  <  ■  ■  ■  <  cm  =  b}  of  [a,  b]  such  that  /  is  constant 
on  each  interval  say  f(x)  =  Cj  for  x  in  (uj-i,Uj). 

(a)  Show  that  a  step  function  /  is  integrable  and  evaluate  /Q6  /. 

(b)  Evaluate  the  integral  JQ4  P(x)  dx  for  the  postage-stamp  function 
P  in  Exercise  17.16. 

33.4  Give  an  example  of  a  function  /  on  [0, 1]  that  is  not  integrable  for 
which  |/|  is  integrable.  Hint :  Modify  Example  2  in  §32. 

33.5  Show  |  flin  z2  sin8(ea:)  dx\  < 

33.6  Prove  (2)  in  the  proof  of  Theorem  33.5.  Hint :  For  xq,  yo  £  S,  we  have 
l/Oo)|  -  \f(yo)\  <  \f(xo)  -  / (2/o)|  <  M(f,  S )  -  m(f,  S). 

33.7  Let  /  be  a  bounded  function  on  [a,  6],  so  that  there  exists  B  >  0  such 
that  |/(x)|  <  B  for  all  x  £  [a,  b\. 

(a)  Show 

C(/2,  P)  -  L(f2,  P)  <  2B[U(f,  P )  -  L(f,  P)} 

for  all  partitions  P  of  [a,  b ].  Hint:  /( x)2  —  f(y)2  =  [f{x)  +  f(y)]  ■ 
[fix)  -  f{y)]- 

(b)  Show  that  if  /  is  integrable  on  [a,  b] ,  then  f2  also  is  integrable 
on  [a,  b] . 
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33.8  Let  /  and  g  be  integrable  functions  on  [a,  b ]. 

(a)  Show  fg  is  integrable  on  [a,  b ].  Hint:  Use  Exercise  33.7  and  4 fg  = 

(/  +  g)2-(/-s)2. 

(b)  Show  max(/,  g)  and  min(/,  g)  are  integrable  on  [a,  b}.  Hint: 
Exercise  17.8. 


33.9  Let  ( fn )  be  a  sequence  of  integrable  functions  on  [a,  b],  and  suppose 
fn~>f  uniformly  on  [a,  b] .  Prove  /  is  integrable  and 


fn- 


Compare  this  result  with  Theorems  25.2  and  33.11. 


33.10  Let  f(x)  =  sin  f  for  x  7^  0  and  /( 0)  =  0.  Show  /  is  integrable  on 
[—1, 1].  Hint:  See  the  answer  to  Exercise  33.11(c). 

33.11  Let  f{x)  =  x  sgn(sin  i)  for  x  ^  0  and  /( 0)  =  0. 

(a)  Show  /  is  not  piecewise  continuous  on  [—1,1]. 

(b)  Show  /  is  not  piecewise  monotonic  on  [—1,1]. 

(c)  Show  /  is  integrable  on  [—1,1]. 

33.12  Let  /  be  the  function  described  in  Exercise  17.14. 

(a)  Show  /  is  not  piecewise  continuous  or  piecewise  monotonic  on 
any  interval  [a,  b\. 

(b)  Show  /  is  integrable  on  every  interval  [a,  b]  and  J ^  /  =  0. 

33.13  Suppose  /  and  g  are  continuous  functions  on  [a,  b]  such  that  /  = 

g.  Prove  there  exists  x  in  (a,  b)  such  that  f(x)  =  g{x). 

33.14  (a)  Prove  the  following  generalization  of  the  Intermediate  Value  The¬ 

orem  for  Integrals.  If  /  and  g  are  continuous  functions  on  [a,  b } 
and  g(t)  >  0  for  all  t  €  [0,6],  then  there  exists  x  in  (a,  b)  such 
that 

pb  pb 

/  f(t)g{t)dt  =  f{x)  /  g{t)dt. 

J  a  J  a 

(b)  Show  Theorem  33.9  is  a  special  case  of  part  (a). 

(c)  Does  the  conclusion  in  part  (a)  hold  if  [a,  6]  =  [—1, 1]  and  f(t)  = 
g(t)  =  t  for  all  £? 
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33.15  For  integers  n  >  3,  define  the  function  fn  on  [0, 1]  by  the  rules: 

fn  (0)  =  fn(~)  =  /n(l)  =  0  and  fn  =  71, 

and  so  that  its  graph  is  a  straight  line  from  (0,0)  to  (-,n),  from 

(£,«)  t0  and  from  (f>°)  t0  (!, 0). 

(a)  Graph  /3,  /4  and  f5. 

(b)  Show  fn  — y  0  pointwise  on  [0, 1]. 

(c)  Show  lim„  fn(x)  dx  JQ  0  dx .  Why  doesn’t  this  contradict 
the  Dominated  Convergence  Theorem? 


§34  Fundamental  Theorem  of  Calculus 

There  are  two  versions  of  the  Fundamental  Theorem  of  Calculus. 
Each  says,  roughly  speaking,  that  differentiation  and  integration  are 
inverse  operations.  In  fact,  our  first  version  [Theorem  34.1]  says  “the 
integral  of  the  derivative  of  a  function  is  given  by  the  function,” 
and  our  second  version  [Theorem  34.3]  says  “the  derivative  of  the 
integral  of  a  continuous  function  is  the  function.”  It  is  somewhat 
traditional  for  books  to  prove  our  second  version  first  and  use  it  to 
prove  our  first  version,  although  some  books  do  avoid  this  approach. 
F.  Cunningham,  Jr.  [18]  offers  some  good  reasons  for  avoiding  the 
traditional  approach: 

(a)  Theorem  34.3  implies  Theorem  34.1  only  for  functions  g  whose 
derivative  g'  is  continuous;  see  Exercise  34.1. 

(b)  Making  Theorem  34.1  depend  on  Theorem  34.3  obscures  the 
fact  that  the  two  theorems  say  different  things,  have  different 
applications,  and  may  leave  the  impression  Theorem  34.3  is  the 
fundamental  theorem. 

(c)  The  need  for  Theorem  34.1  in  calculus  is  immediate  and  easily 
motivated. 

In  what  follows,  we  say  a  function  h  defined  on  (a,  b )  is  integrable 
on  [a,  5]  if  every  extension  of  h  to  [a,  b]  is  integrable.  In  view  of 
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Exercise  32.7,  the  value  fa  h  will  not  depend  on  the  values  of  the 
extensions  at  a  or  b. 


34.1  Fundamental  Theorem  of  Calculus  I. 

If  g  is  a  continuous  function  on  [ a,b ]  that  is  differentiable  on  (a,b), 
and  if  g'  is  integrable  on  [a,  b],  then 

[  g'  =  g{b)  -  g{a).  (1) 

J  a 

Proof 

Let  e  >  0.  By  Theorem  32.5,  there  exists  a  partition  P  =  {a  =  to  < 
t\  <  ■  ■  ■  <  tn  =  b}  of  [a,  6]  such  that 


U(g',P)  —  L(g',P)  <  e. 


(2) 


We  apply  the  Mean  Value  Theorem  29.3  to  each  interval  [t/~-i,tk]  to 
obtain  x k  in  (ffc_i,ifc)  for  which 

(4  -  tk-i)g'(xk)  =  g{tk)  -  g{tk-i). 

Hence  we  have 

n  n 

g(b)  -  g{a)  =  ^b(4)  -  gifk- 1)]  =  ^  ff'Ofc)(4  -  4-i)- 

k= 1  fc=l 

It  follows  that 

L{g',P)  <  g(b)  -  g{a)  <  U(g',P)\ 


(3) 


see  Definition  32.1.  Since 


L(g',P)<  /  g'<u(g',P), 

J  a 

inequalities  (2)  and  (3)  imply 

g'  -  [g(b)  -  g{a)}  <  e. 

2 

Since  e  is  arbitary,  (1)  holds.  ■ 

The  integration  formulas  in  calculus  all  rely  in  the  end  on 
Theorem  34.1. 
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Example  1 

If  g{x)  =  then  g'{x)  =  xn ,  so 


In  particular, 


bn+i  an+ 1 

n  +  1  n  +  1 


bn+ 1  -  an+1 
n  +  1 


(1) 


b3  —  a3 


3 


fi-\- 1 

Formula  (1)  is  valid  for  any  powers  n  for  which  g(x)  =  xn+1  is 
defined  on  [a,b\.  See  Examples  3  and  4  in  §28  and  Exercises  29.15 
and  37.5.  For  example, 


~[63/2  -  a3/2]  for  0  <  a  <  b. 
3 


□ 


34.2  Theorem  [Integration  by  Parts]. 

If  u  and  v  are  continuous  functions  on  [a,  6]  that  are  differentiable 
on  (a,b),  and  if  v!  and  v1  are  integrable  on  [a,b\,  then 


rb  rb 

u{x)v'{x)dx+  /  u'(x)v(x)  dx  =  u(b)v(b)  —  u(a)v{a).  (1) 


Proof 

Let  g  =  uv,  then  g'  =  uv'  +  u'v  by  Theorem  28.3.  Exercise  33.8  shows 
g'  is  integrable.  Now  Theorem  34.1  shows 

g'{x)  dx  =  g(b)  —  g(a)  =  u(b)v(b )  —  u(a)v(a), 


so  (1)  holds. 


Note  the  use  of  Exercise  33.8  above  can  be  avoided  if  u'  and  v' 
are  continuous,  which  is  normally  the  case. 


Example  2 

Here  is  a  simple  application  of  integration  by  parts.  To  calculate 
Jq  x  cos  x’  dx,  we  note  the  integrand  has  the  form  u(x)v'{x)  where 
u(x)  =  x  and  v(x)  =  sins.  Hence 
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xcosxdx  =  u(tt)v(tt)  —  u(0)w(0)—  /  l-sinxdx  =  —  /  sin  xdx 


f 

Jo 


-2. 

□ 


In  what  follows  we  use  the  convention 


Jb  /  for  a  >  b. 


34.3  Fundamental  Theorem  of  Calculus  II. 

Let  f  be  an  integrable  function  on  [ a,b ].  For  x  in  [ a,b ],  let 

F(x)=  f  f(t)dt. 

J  a 

Then  F  is  continuous  on  [a,b\.  If  f  is  continuous  at  xo  in  ( a,b ),  then 
F  is  differentiable  at  xq  and 

F'{x  0)  =  f(x0). 


Proof 

Select  B  >  0  so  that  \  f(x)\  <  B  for  all  x  E  [a,  b].  If  x,  y  E  [a,  b]  and 
\x  —  y\  <  where  x  <  y,  say,  then 


\F(y)-F(x)\  = 


f  f{t)dt  <  f  \f(t)\dt<  f  B  dt=B(y-x)  < 

J  X  J  X  j  X 


This  shows  F  is  [uniformly]  continuous  on  [a,  b\. 
Suppose  /  is  continuous  at  xq  in  (a,  b).  Observe 


Fix)-F(xa)=^_  r 
x-x0  x-  x0  JXo 

for  x  7^  xo-  The  trick  is  to  observe 

/Oo)  =  — - —  [  f{x0)dt, 

%  Xo  J  xo 

and  therefore 

F(x)  -  /(xo)  _  =  r[m_f{xo)]dt  (1) 

x-  Xo  x-  x0  JXo 

Let  e  >  0.  Since  /  is  continuous  at  xq,  there  exists  <5  >  0  such  that 


t  E  (a,  b)  and  1 1  -  x0|  <  5  imply  |/(t)  -  f(x0) \  <  e; 
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see  Theorem  17.2.  It  follows  from  (1)  that 


F(x)  -  Fjx q) 

X  —  Xq 


fix  o) 


<  e 


for  x  in  (a,  b )  satisfying  \x  —  xo|  <  <5;  the  cases  x  >  xq  and  x  <  xq 
require  separate  arguments.  We  have  just  shown 


lim 

X^-XQ 


F(x)  -  F(x q) 

X  —  Xo 


In  other  words,  F'(x o)  =  f(x o). 


fix  o)- 


A  useful  technique  of  integration  is  known  as  “substitution.”  A 
more  accurate  description  of  the  process  is  “change  of  variable.”  The 
technique  is  the  reverse  of  the  chain  rule. 

34.4  Theorem  [Change  of  Variable]. 

Let  u  be  a  differentiable  function  on  an  open  interval  J  such  that  v! 
is  continuous,  and  let  I  be  an  open  interval  such  that  u{x)  £  I  for 
all  x  £  J.  If  f  is  continuous  on  I,  then  f  ou  is  continuous  on  J  and 

rb 

/  /  o  u(x)v! (x)  dx  =  /  f(u)du  (1) 

Ja  J  u(a) 

for  a ,  b  in  J . 

Note  u{a)  need  not  be  less  than  u{b),  even  if  a  <  b. 


Proof 

The  continuity  of  f  o  u  follows  from  Theorem  17.5.  Fix  c  in  I  and  let 
F{u)  =  f(u  fit )  dt.  Then  F\u)  =  f(u)  for  all  u  £  I  by  Theorem  34.3. 
Let  g  =  F  o  u.  By  the  Chain  Rule  28.4,  we  have 

g\x)  =  F'{u{x))  ■  u'{x)  =  fiu{x))  ■  u'(x), 


so  by  Theorem  34.1 

fb 

/  /  o  u(x)v!  (x)  dx 


(x)  dx  =  g(b )  -  g(a)  =  F(u(b))  -  F(u(a)) 


fit)dt. 


This  proves  (1). 
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Example  3 

Let  g  be  a  one-to-one  differentiable  function  on  an  open  interval  I. 
Then  J  =  g(I)  is  an  open  interval,  and  the  inverse  function  g^1  is 
differentiable  on  J  by  Theorem  29.9.  We  show 


rg(b) 

g(x)  dx  +  /  g~l  (u)  du  =  b  ■  g(b)  —  a  ■  g(a) 

Jg(a) 


(1) 


rb  rg(b) 

/  5”1  og(x)g'(x)dx  =  / 

J  a  J  aid) 


for  a,  b  in  I. 

We  put  /  =  g-1  and  u  =  g  in  the  change  of  variable  formula  to 
obtain 

rb  rg(b) 

j  du. 

h{a) 

Since  g ~1  o  g(x)  =  x  for  x  in  I,  we  obtain 

rg(b)  rb 

/  g~1(u)du=  /  xg'(x)dx. 

J  g(a)  Ja 

Now  integrate  by  parts  with  u(x)  =  x  and  v{x)  =  g(x): 

rg(b)  rb 

/  g  (u)  du  =  b  ■  g(b)  -  a-  g(a)  -  g{x)dx. 

J  g(a)  Ja 


This  is  formula  (1). 


□ 


Exercises 

34.1  Use  Theorem  34.3  to  prove  Theorem  34.1  for  the  case  g'  is  continuous. 
Hint'.  Let  F(x)  =  fa'  g' :  then  F'  =  g' .  Apply  Corollary  29.5. 

34.2  Calculate 

(a)  limx_>0  y  fg  e‘2  dt  (b)  lim^^0  £  e ^  dt. 

34.3  Let  /  be  defined  as  follows:  f(t)  =  0  for  t  <  0;  f(t)  =  t  for  0  <  t  <  1; 
f{t)  =  4  for  t  >  1. 

(a)  Determine  the  function  F{x)  =  f{t)  dt. 

(b)  Sketch  F.  Where  is  F  continuous? 

(c)  Where  is  F  differentiable?  Calculate  F'  at  the  points  of 
differentiability. 
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34.4  Repeat  Exercise  34.3  for  /  where  f(t)  =  t  for  t  <  0;  /(f)  =  t2  +  1  for 
0  <  t  <  2;  /(f)  =  0  for  t  >  2. 

34.5  Let  /  be  a  continuous  function  on  R  and  define 


F(x)  = 


rx+ 1 

Jx-1 


f(t)  dt 


for  x  S  R. 


Show  F  is  differentiable  on  R  and  compute  F' . 

34.6  Let  /  be  a  continuous  function  on  R  and  define 


/*sin  x 

G{x)  =  /  f(t)  dt  for  x  £  M. 

Jo 


Show  G  is  differentiable  on  R  and  compute  G' . 

34.7  Use  change  of  variables  to  integrate  fg  x\Jl  —  x2  dx. 

34.8  (a)  Use  integration  by  parts  to  evaluate 

/  xarctana;  cfe. 


Hint:  Let  u(x)  =  arctana;,  so  that  u'(x)  = 


l+x2 


(b)  If  you  used  v(x)  =  ^-  in  part  (a),  do  the  computation  again 
with  v(x)  =  x  ■  This  interesting  example  is  taken  from  J.L. 
Borman  [10]. 

34.9  Use  Example  3  to  show  arcsinxdx  =  ^  ^  —  1. 

34.10  Let  g  be  a  strictly  increasing  continuous  function  mapping  [0, 1]  onto 
[0, 1].  Give  ageometric  argument  showing  fg  g(x)dx+ f*  g~x  (u)du=  1. 

34.11  Suppose  /  is  a  continuous  function  on  [a,  b].  Show  that  if  J ^  f{x)2dx 
=  0,  then  f(x)  =  0  for  all  x  in  [a,  b].  Hint:  See  Theorem  33.4. 

34.12  Show  that  if  /  is  a  continuous  real-valued  function  on  [a,  b]  satisfying 
fa  f(x)g(x)  dx  =  0  for  every  continuous  function  g  on  [a,  6],  then 
f(x)  =  0  for  all  x  in  [a,  6]. 
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§35  *  Riemann-Stieltjes  Integrals 

In  this  long  section  we  introduce  a  useful  generalization  of  the  Rie- 
mann  integral.  In  the  Riemann  integral,  all  intervals  of  the  same 
length  are  given  the  same  weight.  For  example,  in  our  definition  of 
upper  sums 

n 

U(f,  P)  =  J2  (*) 

k=  1 

the  factors  (tf.  —  tk- 1)  are  the  lengths  of  the  intervals  involved.  In 
applications  such  as  probability  and  statistics,  it  is  desirable  to  mod¬ 
ify  the  definition  so  as  to  weight  the  intervals  according  to  some 
increasing  function  F.  In  other  words,  the  idea  is  to  replace  the  fac¬ 
tors  (tfc  —  tk~i)  in  (*)  by  [F(tk)  —  F(tk~i)]-  The  Riemann  integral  is, 
then,  the  special  case  where  F(t)  =  t  for  all  t. 

It  is  also  desirable  to  allow  some  points  to  have  positive  weight. 
This  corresponds  to  the  situation  where  F  has  jumps,  i.e. ,  where 
the  left-hand  and  right-hand  limits  of  F  differ.  In  fact,  if  (c*,)  is  a 
sequence  in  M,  then  the  sums 

OO 

£>/(«*) 

k=  1 

can  be  viewed  as  a  generalized  integral  for  a  suitable  F  [see  Exam¬ 
ples  1  and  3  on  pages  301  and  309].  In  this  case,  F  has  a  jump  at 
each  Uk- 

The  traditional  treatment,  in  all  books  that  I  am  aware  of,  re¬ 
places  the  factors  (tfc  —  tk-i)  in  (*)  by  [F(tk)  —  F(tk- 1)]  and  develops 
the  theory  from  there,  though  some  authors  emphasize  upper  and 
lower  sums  while  others  stress  generalized  Riemann  sums.  In  this 
section,  we  offer  a  slightly  different  treatment,  so 

Warning.  Theorems  in  this  section  do  not  necessarily  correspond  to 
theorems  in  other  texts. 

We  deviate  from  tradition  because: 

(a)  Our  treatment  is  more  general.  Functions  that  are  Riemann- 
Stieltjes  integrable  in  the  traditional  sense  are  integrable  in  our 
sense  [Theorem  35.20]. 
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(b)  In  the  traditional  theory,  if  /  and  F  have  a  common  discontinu¬ 
ity,  then  /  is  not  integrable  using  F.  Such  unfortunate  results 
disappear  in  our  approach.  We  will  show  piecewise  continu¬ 
ous  and  piecewise  monotonic  functions  are  always  integrable 
using  F  [Theorem  35.17].  We  also  will  observe  that  if  F  is  a 
step  function,  then  all  bounded  functions  are  integrable;  see 
Example  1. 

(c)  We  will  give  a  definition  involving  Riemann-Stieltjes  sums  that 
is  equivalent  to  our  definition  involving  upper  and  lower  sums 
[Theorem  35.25].  The  corresponding  standard  definitions  are 
not  equivalent. 

As  just  explained,  our  development  of  Riemann-Stieltjes  integrals 
has  several  positive  features.  However,  this  section  is  long  with  lots  of 
technical  details.  Therefore,  we  recommend  readers  omit  the  proofs 
on  first  reading,  and  then  decide  whether  to  go  through  the  details. 

Many  of  the  results  in  this  section  are  straightforward  general¬ 
izations  of  results  in  §§32  and  33.  Accordingly,  many  proofs  will  be 
brief  or  omitted. 

35.1  Notation. 

We  assume  throughout  this  section  that  F  is  an  increasing  function 
on  a  closed  interval  [a,b\.  To  avoid  trivialities  we  assume  F(a)  < 
F(b).  All  left-hand  and  right-hand  limits  exist;  see  Definition  20.3 
and  Exercise  35.1.  We  use  the  notation 

F(t~ )  =  lim  F(x)  and  F(t+ )  =  lim  F(x). 

i->i_  x—¥t+ 

For  the  endpoints  we  decree 

F(a~)  =  F(a)  and  F(b+)  =  F(b). 

Note  that  F(t~ )  <  F(t+)  for  all  t  6  [a,  b\.  If  F  is  continuous  at  t,  then 
F(t~)  =  F(t)  =  F(t+).  Otherwise  F(t~)  <  F(t+)  and  the  difference 
F(t+)  —  F{t~ )  is  called  the  jump  of  F  at  t.  The  actual  value  of  F(t) 
at  jumps  t  will  play  no  role  in  what  follows.  □ 

In  the  next  definition  we  employ  some  of  the  notation  established 
in  Definition  32.1. 
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35.2  Definition. 

For  a  bounded  function  /  on  [a,  b]  and  a  partition  P  =  {a  =  to  < 
t\  <  ■  ■  ■  <  tn  =  6}  of  [a,  b],  we  write 

n 

Mf, P)  =  J2 /(4)  •  Wk)  - F(tk)]-  (!) 

k= 0 

The  upper  Darboux-Stieltjes  sum  is 

n 

uF(f,  p )  =  Mf,  p)  +  Y,  M(/’  (4-i,  4))  •  (2 *) 

k= 1 

and  the  lower  Darboux-Stieltjes  sum  is 

n 

LF(f,P )  =  Mf,P)  +  (4-i,4))  •  [^(tfc)  -  ^Otr)]-  (3) 

k= 1 

These  definitions  explicitly  take  into  account  the  possible  jump 
effects  of  T  at  the  points  4,  though  F  may  have  jumps  at  other 
points.  The  other  terms  focus  on  the  effect  of  F  on  the  open  intervals 
(4_i,4).  Observe 

n  n 

M]  =  U<**>uU  (4— i,  4-) 

k= 0  k= 1 

represents  [a,  b]  as  a  disjoint  union.2  See  Remarks  35.26  for  a  discus¬ 
sion  about  the  choice  of  open  intervals  versus  closed  intervals  in  the 
definitions  of  Riemann  integrals  and  Riemann-Stieltjes  integrals. 
Note 

UF(f ,  P)  —  LF(f ,  P) 

U 

=  (4-1 ,4))  -m(f,  (4-1,4))] [Fitf)  ~F(tM)}  4 

k=  1 

and 

m(f,  [ o,6 ])  •  [F(b)  -  F(a)}  <  LF(f,P )  <  M/,P) 

<M(/,[a,6])-[F(6)-F(a)].  (5) 


2In  measure  theory  this  is  an  example  of  a  measurable  partition,  that  is  to  say, 

a  family  of  measurable  sets  with  disjoint  union  [a,b\. 


§35.  *  Riemann-Stieltjes  Integrals  301 


In  checking  (5),  note 


E  (F(7)  *  FM  +  EtFK)  -  F(*L,)1 
‘"=  mi)  -  m) + §L  imi)  -  c(t+_1)i 

=  F(a+)  -  F(a~)  +  F(b+)  -  F(a+)  =  F{b)  -  F{a ), 


(6) 


since  the  last  sum  is  a  telescoping  sum.  The  upper  Darboux-Stieltjes 
integral  is 


UfU)  =  inf{f7i?(/,  P)  :  P  is  a  partition  of  [ a,b ]}  (7) 

and  the  lower  Darboux-Stieltjes  integral  is 


Lp(f)  =  sup{Li?(/,  P)  :  P  is  a  partition  of  [a,  b}}.  (8) 


Theorem  35.5  below  states  that  Lp{f )  <  C/f(/).  Accordingly,  we 
say  /  is  Darboux-Stieltjes  integrable  on  [a,  b]  with  respect  to  F  or, 
more  briefly,  F-integrable  on  [a,  b],  provided  Lp(f)  =  Up(f);  in  this 
case  we  write 


fix)  dF(x ) 


LfU) 


UfU). 


Example  1 

For  each  u  in  [a,b\,  let 

Ju(t) 


for  u  >  a,  and  let 


Ja(t) 


0  for  t  <  u, 
1  for  t  >  u, 


0  for  t  =  a, 
1  for  t  >  a. 


Then  Ju  is  an  increasing  step  function  with  jump  1  at  u.  Also,  every 
bounded  function  /  on  [a,  b\  is  Ju-integrable  and 


/(«)• 
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y 


More  generally,  if  u\,  112,  ■  ■  ■ ,  um  are  distinct  points  in  [a,  b]  and  if 
ci,  C2, . . . ,  Cm  are  positive  numbers,  then 

m 

f = t:  cjjUl 

3= 1 


is  an  increasing  step  function  with  jumps  Cj  at  Uj.  See  Fig.  35.1  for  a 
special  case.  Every  bounded  function  /  on  [a,  b]  is  F-integrable  and 


(1) 


To  check  (1),  first  note  the  validity  of  (1)  will  not  change  if  some 
of  the  Uj  are  not  jump  points  so  that  Cj  =  0.  So  we  may  assume  a 
and  b  are  in  {uj  :  1  <  j  <  m},  and  a  =  u±  <  112  <■■■  <  um  =  b.  Let 
P  be  the  partition  {a  =  u\  <  U2  <  ■  ■  ■  <  um  =  b}.  Then  we  have 
F(Uj)  -  F(uj)  =  cj  for  j  =  1,2, ...  ,m  and  F(uJ )  -  i?(u‘L1 )  =  0 
for  j  =  2, 3, . . . ,  m.  Therefore 

m 

uF{f,  p )  =  LF(f,  P)  =  Mf ,  P)  =  J2  /K)  • c; 

3= 1 
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for  any  bounded  function  /  on  [a,  b\.  From  (7)  and  (8)  in 
Definition  35.2  and  LF(f)  <  UF(f),  it  follows  that 

m 

UF(f)  =  LF(f)  =  J2f(uj)-cj. 

3=1 

Hence  /  is  F-integrable  and  (1)  holds.  □ 

Example  2 

We  specialize  Example  1  to  the  case  u\  =  0,  U2  =  1,  113  =  2,  14  =  3; 
ci  =  C4  =  g,  C2  =  C3  =  |.  Thus  we  must  have  a  <  0  and  b  >  3;  see 
Fig.  35.1.  For  any  bounded  function  /  on  [a,  b],  we  have 

JjdF=  If®  +  §/(!)  +  |/(2)  +  ^/(3). 


35.3  Lemma. 

Let  f  be  a  bounded  function  on  [a,  6],  and  let  P  and  Q  be  partitions 
of  [a,b\  such  that  P  C  Q.  Then 

LF(f,P)  <  LF(f,Q)  <  UF(f,  Q)  <  UF(f,P).  (1) 


Proof 

We  imitate  the  proof  of  Lemma  32.2  on  page  273  down  to,  but  not 
including,  formula  (3).  In  the  present  case,  the  difference  LF(f ,  Q)  — 
LF(f,P)  equals 

f{u)  ■  [E(u+)  -  F(u~)]+m(f,  (4-i,  u))  ■  [F(u~)  -  Fft^)] 
+m(f,  ( u,tk ))  •  [F(tf)  -  F{u+ )] 

— m(/,  (4-1,4))  ■  [F(tl)-F(tl_  1)], 

and  this  is  nonnegative  because 

m(f,  (4-1,4))  '  [F(t^)-F(t+_  1)] 

=  rn(f ,  (4-1,4))  ’  -  F(u+)  +  F(u+)  -  F(u~) 

+F(u-)-F(4_1)} 

<  m(f,  (u,  4))  ■  [F(tk  )  -  F(u+)]  +  f(u)  ■  [E(u+)  -  F(u  )] 
+m(/,  (4-1,  u))  ■  [F(u-)  -  E(tfc_!)]. 


(3) 
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35.4  Lemma. 

If  f  is  a  bounded  function  on  [a,  b]  and  if  P  and  Q  are  partitions  of 
[a,b],  then  LF(f,P)  <  UF(f,Q). 

Proof 

Imitates  the  proof  of  Lemma  32.3  on  page  273.  ■ 

35.5  Theorem. 

For  every  bounded  function  f  on  [ a,b ],  we  have  Lp{f)  <  UF(f). 

Proof 

Imitates  the  proof  of  Theorem  32.4  on  page  274.  ■ 

35.6  Theorem. 

A  bounded  function  f  on  [a,  b]  is  F -integrable  if  and  only  if  for  each 
e  >  0  there  exists  a  partition  P  such  that 

UF(f,P)-LF(f,P)<e. 

Proof 

Imitates  the  proof  of  Theorem  32.5  on  page  274.  ■ 

We  next  develop  analogues  of  results  in  §33;  we  return  later  to 
generalizations  of  items  Definition  32.6  through  Theorem  32.9.  We 
begin  with  the  analogue  of  Theorem  33.2.  The  analogue  of  Theo¬ 
rem  33.1  is  true,  but  its  proof  requires  some  preparation,  so  we  defer 
it  to  Theorem  35.16. 

35.7  Theorem. 

Every  continuous  function  f  on  [a,  b]  is  F -integrable. 

Proof 

To  apply  Theorem  35.6,  let  e  >  0.  Since  /  is  uniformly  continuous, 
there  exists  8  >  0  such  that 

x,y€[a,b]  and  \x-y\<5  imply  \f(x)-f{y)\  <  6  . 

r{b)-  F  [a) 

Just  as  in  the  proof  of  Theorem  33.2,  there  is  a  partition  P  of  [a,  b] 
such  that 

e 


M(/,  (4-1,4))  -  rn{f,  (4-1,4))  < 


m  ~  F(a) 
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for  each  k.  Hence  by  (4)  of  Definition  35.2  we  have 

n 

UF(f,P )  -  LfU,  P)  <  E  mL  F(a)Wi)  -  P(‘t- i)l  £ 

Theorem  35.6  now  shows  /  is  T-integrable.  ■ 

35.8  Theorem. 

Let  f  and  g  be  F -integrable  functions  on  [ a,b ],  and  let  c  be  a  real 
number.  Then 

(i)  cf  is  F -integrable  and  Jb(cf)dF  =  c  JbfdF] 

(ii)  f  +  g  is  F -integrable  and  fb{f  +  g)  dF  =  f  dF  +  J *  g  dF. 

Proof 

Imitates  the  proof  of  Theorem  33.3,  using  Theorem  35.6  instead  of 
Theorem  32.5.  ■ 


35.9  Theorem. 

If  f  and  g  are  F -integrable  on  [a,b\  and  if  f(x)  <  g(x)  for  x  E  [a,b\, 
then  jbafdF  <  JbgdF. 

Proof 

Imitates  the  proof  of  Theorem  33.4(i).  ■ 


35.10  Theorem. 

If  f  is  F -integrable  on  [a,b],  then  \  f\  is  F -integrable  and 


< 


I /I  dF. 


Proof 

Imitates  the  proof  of  Theorem  33.5  and  uses  formula  (4)  of 
Definition  35.2.  ■ 


35.11  Theorem. 

Let  f  be  a  function  defined  on  [a,b].  If  a  <  c  <  b  and  f  is  F -integrable 
on  [a,  c]  and  on  [c,b],  then  f  is  F -integrable  on  [a,b\  and 


fdF  + 


f  dF. 


(1) 
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Proof 

Imitates  the  proof  of  Theorem  33.6.  Note  that  an  upper  or  lower  sum 
on  [o,  c]  will  include  the  term  f(c)[F(c)  —  F(c-)]  while  an  upper  or 
lower  sum  on  [c, b\  will  include  the  term  f(c)[F(c+ )  —  F(c)].  ■ 

The  next  result  clearly  has  no  analogue  in  §32  or  §33. 

35.12  Theorem. 

(a)  Let  F\  and  F2  be  increasing  functions  on  [ a,b ].  If  f  is  F\- 
integrable  and  F2-integrable  on  [a,  6]  and  if  c  >  0,  then  f  is 
cFi-integrable,  f  is  (F\  +  F2)-integrable, 

[b  fd(cF1)=c  f  fdFu  (1) 

J  a  J  a 

and 

[b  f  d{F\  +  F2)  =  f  f  dF1  +  f  f  dF2.  (2) 

J  a  J  a  J  a 

(b)  Let  ( Fj )  be  a  sequence  of  increasing  functions  on  [a,b]  such  that 
F  =  Yl’jLi  Fj  defines  an  (automatically  increasing)  function  on 
[a,b].  Thus  the  series  converges  on  the  entire  interval  [a,b\,  and 
F(a)  and  F(b)  are  finite.  If  a  bounded  function  f  on  [a,b]  is 
Fj-integrable  for  each  j ,  then  f  is  F-integrable  on  [ a,b ]  and 


Proof 

From  Theorem  20.4  we  see 

(Fi  +  F2)(t+)  =  lim  [Fi(:c)  +  F2(x)\  =  lim  Fi(:c)  +  lim  F2(x ) 

2— >t+  2— x— H+ 

=  Fi(t+)  +  F2(t+) 

with  similar  identities  for  (Fi  +  F2)(t~),  (cFi)(t+)  and  (c.Fi)(t-). 
Hence  for  any  partition  P  of  [a,  b],  we  have 

UFi+f2  (/,  P)  =  UFl  (/,  P)  +  UF2  (/,  P ) 

LFl+Fa(f,P)  =  LFl(f,P)  +  LFa(f,P), 


(4) 
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UcFl  (/,  P)  =  cUFl  (/,  P)  and  LcFl  (/,  P)  =  cLFl  (/,  P).  It  is  now  clear 
that  /  is  cPi-integrable  and  that  (1)  holds.  To  check  (2),  let  e  >  0. 
By  Theorem  35.6  and  Lemma  35.3,  there  is  a  single  partition  P  of 
[a,  b }  so  that  both 

UFl  (/,  P)  -  LFl  (/,  P)  <  |  and  UF2  (/,  P)  -  Lp2  (/,  P)  <  |. 
Hence  by  (4)  we  have 

UFi+F2(f,P)  ~  LFl+F2(f,P )  <  e- 

This  and  Theorem  35.6  imply  /  is  (Pi  +  P2)-integrable.  The  identity 
(2)  follows  from 


f 


f  d(F1  +  P2)  <  UFl+F2(f,  P)  <  LFl+F2(f,  P )  +  e 


=  LFl  (/,  P)  +  Lp2(f,  P)  +  e  <  /  /dPi+/  /dP2  +  e 


and  the  similar  inequality 

rb 


/d(Pi+P2)>  /  /dPi+  /  / dP2  —  e. 


Now  we  prove  part  (b).  We  write  5m  for  X]j=i  anci  for  the 
difference  (or  tail  sum)  P  —  Sm  =  Pj-  Let  B  be  a  positive 

bound  for  |/|  on  [a,  b],  and  consider  e  >  0.  Select  a  positive  integer 
mo  so  that 


We  will  show 


\Tm(b)  —  Tm(a)\  <  —  for  m  >  m0. 
5  B 


UF(f)  —  LF(f)  < 

5 


(5) 


(6) 


Since  e  >  0  is  arbitrary,  this  will  imply  UF(f)  =  LF(f),  so  that  /  is 
P-integrable.  We  will  also  show 


fdF-  /  fdS„ 


<  e  for  m  >  m q. 


(7) 


Since  e  >  0  is  arbitrary,  and  f^fdSm  =  Y2jLi  fa  f  dFj  by  (2),  this 
will  confirm  (3). 
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We  now  prove  (6).  First  we  claim 

\UF(f,P)—Usm(f,P)\  <  —  for  all  partitions  P  of  [a,b\  and  m  >  mo, 

o 

(8) 

|Lf(/,  P)-LSrn{f,  P)\  <  —  for  all  partitions  P  of  [a,  b]  and  m  >  mo- 

5 

(9) 

Let  P  =  {a  =  t0  <  h  <  ■  ■  ■  <  tn  =  b}.  Note  Tm  =  YJf=m+ 1  F:i  is 
an  increasing  function  on  [o,  b],  so  using  Eq.  (2)  in  Definition  35.2  on 
page  300,  the  left-hand  side  of  inequality  (8)  is  bounded  by 

n  n 

-  Tm(t-)}  +J2BlTm(^)  -  Tm(t+_1)]. 

k= 0  fc=l 


This  sum  is  equal  to  B\Tm(b+)  —  Tm(a~)\  =  B[Tm(b)  —  Tm(a)\  which, 
by  (5),  is  less  than  so  (8)  holds.  The  verification  of  (9)  is  similar. 

In  view  of  (2),  /  is  5m-integrable  for  each  m,  so  for  each  m  there 
is  a  partition  Pm  of  [a,  b]  satisfying 

USm(f,Pm)-LSm(f,Pm)<^  (10) 

Now  we  apply  the  triangle  inequality  to  (8)  and  (9)  [with  P  =  Pm\ 
and  (10)  to  obtain 


UF(f,Pm)  ~  LF(f,Pm)  <  yr  for  m>m0.  (11) 

5 

This  implies  (6);  therefore  /  is  E-integrable. 

Now  (11)  and  (10)  imply 

UF(f,Pm)-  I  fdF  and  USm(f,Pm)-  [  fdSm<  | 


for  m  >  mo-  Applying  these  inequalities  and  (8),  we  obtain 


ffdF-f 


fdS„ 


<  e  for  m  >  m o, 


i.e.,  (7)  holds. 
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Example  3 

(a)  Let  (uj)  be  a  sequence  of  distinct  points  in  [a,b\,  and  let  (cj)  be 
a  sequence  of  nonnegative  numbers3  such  that  cj  <  oo.  Using  the 
notation  of  Example  1  on  page  301,  we  define 

OO 

F  =  X/  cj^ur 

3=1 

Then  F  is  an  increasing  function  on  [a,  b\\  note  F(a)  =  0  and  F(b)  = 
Yl'jLi  cj  <  oo.  Every  bounded  function  /  on  [a,  b]  is  F-integrable  and 


(1) 


This  follows  from  Theorem  35.12(b)  with  Fj  =  CjJu. ,  since  every 
bounded  function  is  Fj-integrable  for  every  j,  as  shown  in  Example  1. 
(b)  The  function  F  in  part  (a)  satisfies 


m  =  ^2{cj  ■  Uj  <  t}  for  t  £  (a,  6],  (2) 

since  JUj(t )  =  1  if  and  only  if  Uj  <  t.  Also  F(a)  =  0.  Moreover, 

F(t~)  =  :  Uj  <  t}  for  t  £  (a,  b],  (3) 


since  F(t~)  =  limx^t-  ^2{cj  :  uj  <  x}.  We  also  have 

F(t+)  =  F(t)  for  t  €  ( a,b ],  (4) 

because  F(b+ )  =  F(b)  by  decree,  and  for  t  £  (a,  b)  and  x  >  t,  we 
have 


F(x)  —  F(t)  =  :  t  <  Uj  <  x},  (5) 

so  that  F(t+)  =  1  imx_+t+  F(x)  =  F(t).  [Details:  Given  e  >  0,  there 
is  N  so  that  X^at+i  Cj  <  e.  For  x  >  t  and  x  sufficiently  close  to  t, 
the  sets  {uj  :  t  <  Uj  <  x}  and  {ui, . . . ,  un}  are  disjoint,  so  the  sum 
in  (5)  is  less  than  e.] 


3  Allowing  some  c/s  to  be  0  won’t  change  the  value  of  F,  of  course,  but  allowing 
Cj’s  to  be  0  is  sometimes  convenient. 
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(c)  A  function  E  is  said  to  be  right  continuous  at  t  if  F(t)  = 
F(t+).  Equation  (4)  shows  F  is  right  continuous  except  possibly 
at  a.  By  (4),  (2)  and  (3),  we  have 

F(t+)  -  F(t~)  =  :  uj  =  t}.  (6) 

Equation  (6)  holds  for  all  t  in  [a,  b],  even  t  =  a.  Therefore,  F  is  contin¬ 
uous  at  t  unless  t  =  Uj  for  some  j.  Finally,  F  is  clearly  discontinuous 
at  each  Uj  unless  Cj  =  0.  □ 

The  next  theorem  shows  E-integrals  can  often  be  calculated  using 
ordinary  Riemann  integrals.  In  fact,  most  E-integrals  encountered  in 
practice  are  either  covered  by  Example  3  or  this  theorem. 

35.13  Theorem. 

Suppose  F  is  differentiable  on  [a,  b]  and  F'  is  continuous  on  [a,  b\ .  If 
f  is  continuous  on  [a,b\,  then 

f  fdF=  f  f(x)F'(x)dx.  (1) 

J  a  J  a 

Proof 

Note  fF'  is  Riemann  integrable  by  Theorem  33.2,  and  /  is  E- 
integrable  by  Theorem  35.7.  By  Theorems  32.5  and  35.6,  there  is 
a  partition  P  =  {a  =  to  <  t\  <■■■<  tn  =  b}  such  that 

U(fF',P)  —  L(fF',P)  <  ~  and  UF(f,P)  —  LF(f,P)  <  (2) 

By  the  Mean  Value  Theorem  29.3  on  page  233  applied  to  E  on  each 
interval  [tk-i,tk],  there  exist  Xk  in  (tk-i,tk)  so  that 

E(tfc)  -  E(tfc-i)  =  F'(xk)(tk  -  tk- 1); 

hence 

n  n 

^2f(xk)  ■  [ F(tk )  -  F(tk-i)]  =  ^2  f(xk)F'(xk )  •  (tk  -  tk- 1).  (3) 

k= 1  k= 1 

Since  E  is  continuous,  it  has  no  jumps  and  (3)  implies 

LF(f,P)  <  U(fF',P)  and  L(fF',P)<UF(f,P). 
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FIGURE  35.2 


Now  by  (2)  we  have 

j"fdF<  UfU,  P)<e-+LF{f,P)<e-  +  U(fF ',  P) 

<  \  +  |  +  L(fF',  P)  <  e  +  jf*  f(x)F\x)  dx 

and  similarly  J ^  /  dF  >  j ^  f(x)F'{x)  dx  —  e.  Since  e  >  0  is  arbitrary, 
(1)  holds.  ■ 

An  extension  of  Theorem  35.13  appears  in  Theorem  35.29. 


Example  4 

Let  F(t)  =0  for  t  <  0,  F(t)  =  t2  for  0  <  t  <  2,  and  F(t)  =  t  +  5 
for  t  >  2;  see  Fig.  35.2.  We  can  write  F  =  F\  +  3J2  where  F\  is 
continuous  and  J2  is  the  jump  function  at  2.  The  function  F\  is 
differentiable  except  at  t  =  2;  the  differentiability  of  F\  at  t  =  0  is 
shown  in  Exercise  28.7.  Let  /  be  continuous  on  [—3,3],  say.  Clearly 
f_3  f  dFi  =  0.  Since  F\  agrees  with  the  differentiable  function  t 2  on 
[0,  2],  we  can  apply  Theorem  35.13  to  obtain 


f(x)  ■  2xdx  =  2 


xf{x) dx. 
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Similarly  we  have 

p3  p3 


[  fdF\  =  f  f(x)-ldx=  f  f(x)dx. 
J  2  J  2  J  2 


Theorem  35.11  now  shows 

p3  /-2 


I  f  dF\  =  2  /  xf(x)dx+  f  f{x)dx , 

X-3  XO  J2 

and  then  Theorem  35.12(a)  shows 

/3  /*3  /*3  /*2  /*3 

fdF=  f  dFi  +  3  /  fdJ2  =  2  /  x/(a;)da:+  /  /(x)  dx  +  3/(2). 

-3  i-3  J-3  -'O  J2 


As  a  specific  example,  if  /(x)  =  x3,  then 


f  f  dF  =  2  f  x4  dx  +  /  xa  dx  +  3  •  8  =  —  =  53.05. 
J —3  Jo  J  2  20 


2 

4  i  /  ™3 , 


1061 


□ 


For  the  proof  of  Lemma  35.15,  we  will  use  the  next  theorem, 
which  is  interesting  in  its  own  right. 


35.14  Theorem. 

Let  F  be  a  right- continuous  increasing  function  on  [a,b\.  Then  we 
have  F  =  Fc  +  Fj,  where  Fc  is  a  continuous  increasing  function  on 
[a,  b],  and  Fj  =  CjJUj  where  {u\,U2,  ■  ■  •}  are  the  jump  points  of  F 
and  Cj  is  the  jump  at  Uj,  i.e.,  Cj  =  F(uJ)  —  F(u~)  for  each  j.  ( If 
there  are  no  jump  points,  then  F  is  continuous,  F  =  Fc  and  Fa  =  0.) 
In  general,  there  might  be  finitely  many  or  infinitely  many  such  Uj, 
so  we  will  not  decorate  the  sums  until  we  need  to. 


See  Examples  1  and  3  on  pages  301  and  309  for  the  notation.  The 
function  Fc  is  called  the  “continuous  part”  of  F,  and  Fj  is  called  the 
“discrete  part”  of  F. 
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Proof 

Let  Fc  =  F  —  Fd.  To  show  Fc  is  an  increasing  function,  it  suffices  to 
show  s  <  t  implies  Fc(s)  <  Fc(t ),  i.e. , 

s  <  t  implies  Fd(t)  —  Fd(s)  <  F(t)  —  F(s). 

By  (2)  in  Example  3(b)  on  page  309,  it  suffices  to  show 

s  <  t  implies  :  s  <  uj  <  t}  <  F(t)  -  F(s).  (1) 

To  show  this,  it  suffices  to  consider  a  finite  subset  E  of  {uj  :  s  < 
Uj  <  t},  which  we  write  as  (to  <  ti  <  ■  •  •  <  tn}  where  s  <  to  and 
tn  <t.  Then 

n 

:  ui  €E^  =  <  F(t+)-F(s)  =  F(t)  —  F(s) 

k= 0 

by  (6)  in  Definition  35.2  on  page  300  with  a  =  s  and  b  =  t.  Since  E 
is  an  arbitrary  finite  subset  of  {uj  :  s  <  Uj  <  t},  (1)  holds. 

To  show  Fc  is  continuous,  first  note  that  if  t  ^  Uj  for  all  j,  then  F 
is  continuous  at  t,  and  F(i  is  continuous  at  t  as  shown  in  Example  3(c). 
So  Fc  =  F  —  Fa  is  continuous  at  t  in  this  case.  Otherwise,  t  =  Uj 
for  some  j.  Then  F(uj~)  —  F(uJ )  =  Cj  by  the  definition  of  Cj,  and 
Fd(uj-)  —  Fd(u~)  =  Cj  by  (6)  of  Example  3(b).  Therefore 

Fc(u+)  -  Fc{u~ )  =  F(uj~)  -  Fd(u+)  -  F(u~)  +  Fd(u~) 


=  [F(u+)  -  F(uj)}  -  [Fd(u+)  -  Fd(uJ )]  =  Cj  -  Cj  =  0, 
so  that  Fc  is  continuous  at  Uj,  as  claimed.  ■ 

It  is  easy  to  check  that  the  representation  of  F  as  Fc  +  Fd  is 
unique  in  the  following  sense:  If  Fc+Fd  =  Gc+Gd  where  G  is  another 
right-continuous  increasing  function,  then  Fc  =  Gc  and  Fd  =  Gd. 

35.15  Lemma. 

If  F  is  an  increasing  function  on  [ a,b }  and  if  e  >  0,  then  there  exists 
a  partition 

P  =  {a  =  to  <  t\  <■■■<  tn  =  b} 
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such  that 

F(tk)  ~  F(tk-i)  <  e  f°r  k  =  l,2,...,n.  (1) 

Proof 

The  conclusion  (1)  does  not  depend  on  the  exact  values  of  F  at  any  of 
its  jump  points,  though  of  course  they  satisfy  F(t~ )  <  F(t)  <  F(t+). 
Hence  it  suffices  to  prove  (1)  after  F  has  been  redefined  at  its  jump 
points.  We  choose  to  define  F(t)  =  F(t+ )  at  all  jump  points,  so  that 
F  is  right  continuous  on  [a,  b] . 

Now  that  F  is  right  continuous,  we  can  apply  Theorem  35.14: 
F  =  Fc  +  'YjCjJv.j  where  Fc  is  continuous,  each  Cj  is  positive,  and 
^3  cj  <  oo.  If  F  is  continuous,  then  the  sum  disappears  and  the  proof 
below  can  be  simplified. 

Given  e  >  0,  select  N  so  that  ci  <  §•  Again,  if  there  are 

only  finitely  many  Uj’s,  this  part  of  the  proof  simplifies.  Since  Fc  is 
uniformly  continuous  on  [a,  b]  [by  Theorem  19.2  on  page  143],  there 
is  5  >  0  so  that 

|s  —  t|  <  6  implies  |Fc(s)  —  Fc(t) \  <  (2) 

Let  P  =  {a  =  to  <  t,\  <  •••  <  be  a  partition  that  includes 
{ui, . . . ,  un}  and  satisfies  | tk  —  tk- 1|  <  8  for  k  =  1, 2, . . . ,  n.  Let 

N  oo 

Fi  =  ^  crJu,j  and  F2  =  ^  CjJUj, 

1=1  j=N+l 

so  that  F  =  Fc  +  F\  +  F2-  For  each  k  =  1, 2, . . . ,  n,  we  have 
-  Fc(*t- 1)  =  FSt)  -  Fc(tk- 1)  <  I  by  (2), 

mi)  -  mU)  =  0 

because  F\  is  constant  on  the  open  interval  an(i 

OO 

-  F2(t+_1)  <  F2(b)  -  F2(a)  <  J2  G  <  !■ 

j=N+ 1 

Since  F  =  Fc  +  Fi  +  F2,  summing  yields  F{t] 7)  —  F (t^_ , )  <  e.  ■ 

35.16  Theorem. 

Every  monotonic  function  f  on  [a,  b]  is  F -integrable. 
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Proof 

We  may  assume  /  is  increasing  and  /  (a)  <  f(b).  Since  /(a)  <  f(x)  < 
f(b)  for  all  x  in  [a,b\,  f  is  bounded  on  [a,  6].  For  e  >  0  we  apply 
Lemma  35.15  to  obtain  P  =  {a  =  t^  <  t±  <■■■<  tn  =  b}  where 


p(t~k)  -  .)  < 


1(b)  -  f(a) 


for  k  =  1,2, ...  ,n.  Since  M(f,(tk_i,tk))  =  f(tk )  <  f(tk )  and 
m{f,  (4-i,4))  =  ^  /(4-i),  we  have 


UF(f,P)  -  LF(f,  P)  <  4)  -  /(4-i)]  •  [F(tk)  -  F(t+_i)] 

fc=i 


<  i)] 

fc=i 


e 

/(&)  -  /(«) 


Since  e  is  arbitrary,  Theorem  35.6  shows  /  is  F-integrable.  ■ 


35.17  Theorem. 

If  f  is  piecewise  continuous,  or  bounded  and  piecewise  monotonic, 
on  [a,b\,  then  f  is  F -integrable. 

Proof 

Just  as  in  the  proof  of  Theorem  33.8,  this  follows  from  The¬ 
orems  35.7,  35.16  and  35.11,  provided  we  have  the  following 
generalization  of  Exercise  32.7.  ■ 


35.18  Proposition. 

If  f  is  F -integrable  on  [a,  b]  and  g(x)  =  f(x)  except  for  finitely  many 
points,  then  g  is  F -integrable.  We  do  not  claim  j'£  f  dF  =  f£  gdF. 

Proof 

It  suffices  to  show  g  —  f  is  F-integrable,  because  then  the  sum 
( g  —  /)  +  /  would  be  F-integrable  by  Theorem  35.8(h).  Thus  it 
suffices  to  assume  g(x)  =  0  except  for  finitely  many  points.  Consider 
any  partition  P  =  {a  =  to  <  4  <  ■  ■  ■  <  4  =  b}  satisfying  g(x)  =  0 
for  all  x  in  [a,  b]  \  4,  ■  ■  •  >  4}-  Then  from  Eqs.  (2)  and  (3)  in  Def¬ 

inition  35.2  on  page  300  we  have  UF(g,P )  =  JF(g,P)  =  LF(g,P), 
so  g  is  clearly  F-integrable;  see  Theorem  35.6,  for  example.  ■ 
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If  F\  and  F2  are  increasing  functions  with  continuous  deriva¬ 
tives,  then  Theorem  35.13  allows  the  formula  on  integration  by  parts 
[Theorem  34.2]  to  be  recast  as 


F\  dF2  +  /  F2  dFi  =  Fi(6)F2(6)  -  Fi(a)F2(o). 


There  is  no  hope  to  prove  this  in  general  because  if  F(t)  =  0  for 
t  <  0  and  F(t)  =  1  for  t  >  0,  then 


FdF+  /  FdF 


i- 1 


2^1  =  F(1)F(1)-F(-1)E(-1). 


The  generalization  does  hold  provided  the  functions  in  the  integrands 
take  the  middle  values  at  each  of  their  jumps,  as  we  next  prove.  The 
result  is  a  special  case  of  a  theorem  given  by  Edwin  Hewitt  [29]. 


35.19  Theorem  [Integration  by  Parts]. 

Suppose  F\  and  F2  are  increasing  functions  on  [o,  b]  and  define 

F?(t)  =  i[Frr)  +  F1(t+)]  and  Ff(t)  =  \[F2{t~)  +  F2{t+ )] 
for  all  t  G  [a,  b\ .  Then 

f  F*  dF2  +  [b  Ff  dF\  =  Fi(b)F2(b)  -  F1{a)F2(a).  (1) 

J  a  J  a 

As  usual,  we  decree  Fi(b+)  =  Fi(b),  Fi(a~ )  =  Fi(a),  etc. 

Proof 

Both  integrals  in  (1)  exist  in  view  of  Theorem  35.16.  For  an  e  >  0, 
there  exists  a  partition  P  =  {a  =  to  <  ti  <  ■  •  •  <  tn  =  b}  such  that 

UFl  {Ff ,  P)  —  LFl(Ff ,  P)  <  e. 

Some  algebraic  manipulation  [discussed  in  the  next  paragraph]  shows 
UF2(Ff,P)  +  LFl  (Ff ,  P)  =  Fi(6)F2(6)  -  Fi(a)F2(a),  (2) 


so  that  also 

UFl  {Ff ,  P )  +  LF2  (Ff ,  P )  =  Fi(6)E2(6)  -  Fi(a)F2(a).  (3) 
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It  follows  from  (2)  that 

Jb  F{  dF2  +  Jb  F*  dF\  <  UF2  (F* ,  P )  +  UFl  (F2* ,  P) 

<UF2(F*,P)  +  LFl(F*,P)  +  e 
=  F1(b)F2{b)  -  F1(a)F2{a)  +  e, 


while  (3)  leads  to 


pb  pb 

/  /■  r  dp2  +  / 

J  a  J  a 


F2  dFi  >  Fi(6)F2(6)  -  Fi(a)F2(a) 


Since  e  is  arbitrary,  (1)  holds. 

It  remains  to  verify  (2).  Observe 


uF2 (f*,  P)  +  LFl (f;,p)  =  E  F*(tk)  ■  [f2(4)  -  F2{rk )] 

n 

+  ^2m(F*,  (tfc-r.t*))  •  [F2(t~k)  -  F2(t+_r)] 

k=l 

n 

fc=0 

n 

+  Em(F2*>  (4-1,4))  •  [^i(ifc  )  -  ^i(ife-i)] 

fc=l 

n 

=  E  0^7)  +  W  )  -  Wk)} 

k= 0  Z 
n 

+  EF^7)-[^)-F2(f+_1)] 

fc=l 

n 

+ E  2 1 [^(*7)  +  ^(*7)]  •  M)  -  m~k)] 

k= 0 
n 

+E^(E1)-[^(^)-^i(Ei)]- 

fc=l 

The  first  and  third  sums  add  to 

n 

YJ[Fi(4)F2{4)-F1(t,)F2(tk)], 


(4) 


6.  Integration 


while  the  second  and  fourth  sums  add  to 

n 

E  i  WDmz)  -  fiW-iJfbW-i)]-  (5) 

k= l 

Since  the  sums  in  (4)  and  (5)  add  to  F\(b)F2{b)  —  Fi(a)F2(a),  by 
Eq.  (6)  in  Definition  35.2  [on  page  300]  applied  to  F1F2,  the  equality 
(2)  holds.  The  preceding  algebra  simplifies  considerably  if  F\  and  F2 
are  continuous.  ■ 

We  next  compare  our  approach  to  Riemann-Stieltjes  integration 
to  the  usual  approach.  For  a  bounded  function  /  on  [a,b\,  the  usual 
Darboux-Stieltjes  integral  is  defined  via  the  upper  sums 

n 

UF(f,P)  =  •  [Ffa)  ~  F(tk-i)] 

k=  1 

and  the  lower  sums 

n 

LF(f,P)  =  Ym(f>  [4-1,4])  •  [F{tk)  ~  F(tk- 1)]. 

k=  1 

~  ~  ~b 

The  expressions  UF(f ),  LF(f)  and  J  f  dF  are  defined  in  analogy  to 
those  in  Definition  35.2  on  page  300.  The  usual  Riemann-Stieltjes 
integral  is  defined  via  the  sums 

n 

SF(f,P)  =  ^f(xk)[F(tk)  -  F(tk- 1)], 

k=  1 

where  xk  is  in  [tk-i,tk],  and  the  mesh  is  defined  in  Definition  32.6; 
compare  Definition  35.24. 

The  usual  Riemann-Stieltjes  integrability  criterion  implies  the 
usual  Darboux-Stieltjes  integrability  criterion;  these  criteria  are  not 
equivalent  in  general,  but  they  are  equivalent  if  F  is  continuous. 
See,  for  example,  [53,  §12.2],  [55,  Chap.  8],  or  [62,  Chap.  6],  the  most 
complete  treatment  being  in  [55]. 

35.20  Theorem. 

If  f  is  Darboux-Stieltjes  integrable  on  [a,  b]  with  respect  to  F  in  the 
usual  sense,  then  f  is  F -integrable  and  the  integrals  agree. 


§35.  *  Riemann-Stieltjes  Integrals  319 


Proof 

For  any  partition  P ,  LF(f,P )  equals 

n 

X  m(f,  [4-1 , 4])  ’  [F(tk)  ~  F(t *  )  +  F{t^ )  -  F(tY) 

k= l 

+P(t+_1)  -  F(4-i)] 

n 

<Yn  tk)[F(tk)  -  Fm] 

k= l 

n 

+  X]  m(fi  (4-1 , 4))  • 

fc=l 

n 

+Ym-i)[F(4_1)-F(tk-1)}. 

k= 1 

The  first  and  third  sums  add  to 

n  n— 1 

X  /(^mm  -  )]  +  X 

/c=l  /c=0 

n— 1 

=  f(tn)[F(tn)  -  F(t~)]  +  X  f(tk)[F(t+)  -  F(t * )] 

fe=i 

+/(*o)[F(f0+)-P(t0)] 

n 

=  Yf^)[F(4)  -  F(t^)}  =  Mf,P). 

k= o 

These  observations  and  a  glance  at  the  definition  of  LF(f,  P )  now 
show  LF(f,  P)  <  LF(f,P )•  Likewise  we  have  UF(f,P)  >  UF(f,  P), 
so 


M/,  -  M/,  F)  <  M/,  F)  -  LF(f,  P).  (1) 


If  e  >  0,  the  usual  theory  [Theorem  32.5]  shows  there  exists  a  parti¬ 
tion  P  such  that  UF{f.  P)  —  LF(f,  P)  <  e.  By  (1)  we  see  that  we  also 
have  UF{f ,  P)  —  LF{f,  P)  <  e,  so  /  is  P-integrable  by  Theorem  35.6. 
To  see  equality  of  the  integrals,  simply  observe 


dF  <  UF(f ,  P)  <  LF(f,  P)  +  e  <  PF(/,  F)  +  e  < 


fdF  +  e 
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and  similarly 


fdF>  /  fdF-e. 


We  will  define  Riemann-Stieltjes  integrals  using  a  mesh  defined 
in  terms  of  F  instead  of  the  usual  mesh  in  Definition  32.6. 

35.21  Definition. 

The  F-mesh  of  a  partition  P  is 

P-mesh(P)  =  ma x{F(t^)  —  P(t^_1)  :  k  =  1,2,...  ,n}. 


It  is  convenient  to  restate  Lemma  35.15: 

35.22  Lemma. 

If  5  >  0,  there  exists  a  partition  P  such  that  P-mesh(P)  <  S. 

35.23  Theorem. 

A  bounded  function  f  on  [a,  b]  is  F -integrable  if  and  only  if  for  each 
e  >  0  there  exists  6  >  0  such  that 

P-mesh(P)  <  5  implies  UF(f,P)  —  LF{f,P)<e  (1) 

for  all  partitions  P  of  [a,  b] . 

Proof 

Suppose  the  e—8  condition  stated  in  the  theorem  holds.  If  we  have 
e  >  0,  then  (1)  applies  to  some  partition  P  by  Lemma  35.22  and 
hence  Pi?(/,  P)  —  Lp(f,P )  <  e.  Since  this  remark  applies  to  all 
e  >  0,  Theorem  35.6  implies  /  is  P-integrable. 

The  converse  is  proved  just  as  in  Theorem  32.7  with  “mesh” 
replaced  by“P-mesh”  and  references  to  Lemma  32.2  replaced  by 
references  to  Lemma  35.3.  ■ 

35.24  Definition. 

Let  /  be  bounded  on  [a,  6],  and  let 

P  =  {a  =  to  <  ti  <  ■  ■  ■  <  tn  =  b}. 
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A  Riemann-Stieltjes  sum  of  /  associated  with  P  and  F  is  a  sum  of 
the  form 

n 

ML  m  £  -  ML 1)] 

fc=i 

where  xk  is  in  (tk~i,tk)  for  k  =  1,  2, . . . ,  n. 

The  function  /  is  Riemann-Stieltjes  integrable  on  [a,  6]  if  there 
exists  r  in  M  with  the  following  property.  For  each  e  >  0  there  exists 
5  >  0  such  that 


|S  —  r\  <  e  (1) 

for  every  Riemann-Stieltjes  sum  S'  of  /  associated  with  a  partition 
P  having  F-mesh(P)  <  6.  We  call  r  the  Riemann-Stieltjes  integral 
of  /  and  temporarily  write  it  as 

US  I  fdF. 


35.25  Theorem. 

A  bounded  function  f  on  [a,  b]  is  F -integrable  if  and  only  if  it  is 
Riemann-Stieltjes  integrable,  in  which  case  the  integrals  are  equal. 

Proof 

The  proof  that  -F-integr  ability  implies  Riemann-Stieltjes  integrabil- 
ity  imitates  the  corresponding  proof  in  Theorem  32.9.  The  proof  of 
the  converse  also  imitates  the  corresponding  proof,  but  a  little  care 
is  needed,  so  we  give  it. 

Let  /  be  a  Riemann-Stieltjes  integrable  function,  and  let  r  be  as 
in  Definition  35.24.  Consider  e  >  0,  and  let  <5  >  0  be  as  provided 
in  Definition  35.24.  By  Lemma  35.22  there  exists  a  partition  P  = 
{a  =  to  <  t\  <■■■<  tn  =  b}  with  F-mesh(P)  <  5.  For  each  k  = 
1,2, ...  ,n,  select  xk  in  (4-1,4)  so  that  f(xk)  <  m(f,  tk))  +  e. 
The  Riemann-Stieltjes  sum  S  for  this  choice  of  x^s  satisfies 

S<LF(f,P)  +  e[F(b)-F(a)} 

and  also 


|5-r|  <  e; 
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hence  Lp(/)  >  Lp(f,P)  >  r  —  e  —  e[F{b)  —  -F(a)].  Since  e  >  0 
is  arbitrary,  it  follows  that  Lp(f)  >  r  and  similarly  Up(f)  <  r. 
Therefore  Lp(f)  =  Uf{I)  =  r.  Thus  /  is  F-integrable  and 


35.26  Remarks. 

In  the  definition  of  upper  and  lower  Darboux  sums,  we  used 
closed  intervals  [tk-i,tk]  for  Riemann  integrals,  in  §32,  and  we 
used  open  intervals  (tk-i,tk)  in  this  section.  The  reason  we  used 
closed  intervals  in  §32  is  because  that  is  completely  standard. 
The  reason  we  used  open  intervals  in  this  section  is  because 
our  development  was  motivated  by  the  desire  to  have  Riemann- 
Stieltjes  integrals  more  compatible  with  their  measure-theoretic 
generalization,  Lebesgue-Stieltjes  integrals,  where  the  “measurable 
partition” 


n  n 

M=  U(*‘luU  (tk—h  tk ) 

k= 0  fc=l 

is  a  natural  starting  point.  Moreover,  the  arguments  in  Examples  1 
and  3  and  in  Proposition  35.18  would  be  somewhat  more  complicated 
if  we  had  used  closed  intervals. 

The  reader  may  wonder  whether  the  theories  would  have  changed 
if  we  had  used  closed  intervals  in  this  section  or  open  intervals  in 
§32.  It  turns  out  there  would  be  no  essential  changes,  as  we  now 
explain.  We  do  so  using  increasing  functions  F,  as  in  this  section;  see 
Corollary  35.28  for  the  case  of  Riemann  integrals.  We  write  Lp(f,  P) 
and  U p(f,P)  for  the  lower  and  upper  Darboux-Stieltjes  sums  using 
closed  intervals  [tk-ipk]  instead  of  open  intervals  (tk-i,tk)-  These 
will  sometimes  be  different  from  the  corresponding  Darboux-Stieltjes 
sums  defined  in  Definition  35.2  on  page  300.  But  if  we  define 

UF{f)  =  inf  P)  :  P  partitions  [a,  6]} 

and  we  define  Lp(f)  similarly,  we  have  the  following  fact. 
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35.27  Proposition. 

If  f  is  bounded  on  [a,b],  then  U  F{f)  —  UF(f)  and  LF(f)  =  LF(f). 
Thus  f  is  integrable  using  closed  intervals  in  the  Darboux-Stieltjes 
definitions  if  and  only  if  it  is  integrable  using  open  intervals,  and  in 
this  case  the  integrals  are  equal. 

Proof 

We  prove  U F(f)  =  UF(f)]  the  proof  of  LF(f )  =  LF(f )  is  similar. 
For  each  partition  P  of  [a,  b],  it  is  clear  that  UF(f,P )  <  UF(f,P). 
Therefore  UF(f)  <  U F(f)  and  it  suffices  to  show 

UfU)  <  UF(f).  (1) 

Let  e  >  0.  There  is  a  partition  P  of  [a,  b]  such  that 

UF{f,P)<UF(f)  +  ~.  (2) 

Note  (2)  holds  for  any  refinement  of  P  by  Lemma  35.3. 

As  before,  if  there  are  any  jumps  we  list  them  as  U\,U2,  ■  ■  ■  and 
define  Cj  =  F(u+)  —  F(uj).  Since  Cj  is  finite,  there  is  an  integer 
N  so  that  Eyliv+i  Cj  <  f .  Of  course,  this  step  is  trivial  if  F  has 
only  finitely  many  jumps.  We  first  refine  P  so  that  for  every  j  <  N, 
the  jump  Uj  is  equal  to  some  tk  in  P.  Then  if  P\  and  P2  are  such 
refinements  of  P,  we  have 

OO 

\Mf,Pi)-Mf,P2)\<  E  o  <  (3) 

j=N+l 

Now  we  further  refine  P  as  follows.  Using  the  definitions  of  F(tf) 
and  F(t^),  we  see  there  are  points  Sk  and  Uk  for  k  =  0, 1, . . . ,  n  so 
that 


a  =  so  =  to  <  Uq  <  si  <  ti  <  u±  <  S2  <  t2  <  U2  <  S3  <  ■  ■  ■ 


^  <C  tn— 1  <  un—\  <C  sn  <C  tn  —  un  —  b , 

and  all  F(u\ 7)  -  F(t^)  and  F(tf)  -  F(s^)  are  less  than 
where  B  is  a  positive  bound  for  the  absolute  value  |/|.  We  estimate 
UF(f,P$)  for  the  new  partition  P N  consisting  of  all  s^,  tF  and  u^. 
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Observe: 

n  n 

E  ^ •  TO  -  F(4)]  <  £  B  •  TO  -  F(4)])  < 

/c=0  /c=0 

n  n 

£ mv ’  tod  ■  TO)  -  TO)  <  Es  •  TO)  -  TO)]  < 

fc=0  A:=0 


and  £Af(/,  [“fc-1,**])  '  )  ~  fTOi)] 

fc=l 
n 

<£>(/,  to**))  •  [to  -  TO-i)]  =  mto  -  w,n 

fc=i 

Summing  these  three  inequalities,  we  see 

TO/,  P #)  -  TO/,  TO  <  TO/,  p)  -  TO/,  P)  +  f  ■ 

Now  we  invoke  (3)  to  conclude 

UF(f, TO  <  uF(f, P )  -  Mf , p)  +  TO/, TO  + 1  <  EM/, TO  j- 

Finally,  using  (2),  we  obtain  UF(f,P **)  <  UF(f)  +  e;  hence 

UF(f)  <  E/f(/,-TO  <  UF(f)  +  e. 

Since  e  is  arbitrary,  (1)  is  established.  ■ 

Proposition  35.27  is  true  for  F(t)  =  t,  so  it  is  true  for  Riemann 
integrals.  However,  for  this  important  case,  we  use  closed  intervals  as 
is  traditional.  Thus  our  notation  U(f,P),  U(f)  refers  to  the  theory 
using  closed  intervals,  and  we  do  not  want  to  confuse  the  situation 
here  by  switching  to  U(f,P,  U(f),  etc.  To  distinguish  the  theory 
using  open  intervals,  we  introduce  new  notation  U^(f,  P),  Ub(f),  etc. 

35.28  Corollary. 

In  $32,  on  the  Riemann  integral,  the  definitions  of  L(f,P)  and 
U(f,P)  for  upper  and  lower  Darhoux  sums  could  have  used  open 
intervals  (ifc-i,^fc)  instead  of  closed  intervals  [tfc_ The  resulting 
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Darboux  sums  Lb(f,  P)  and  U^(f,P)  might  be  different.  But  if  we 
define 


Ub(f)  =  inf{t/b(/,  P)  :  P  partitions  [a,  6]} 


and  we  define  Lf{f)  similarly,  then  we  have  U^(f)  =  U(f)  and 
Lf{f)  =  L(f).  Thus  the  two  approaches  to  Riemann  integration  give 
the  same  integrals. 


Proof 


This  is  Proposition  35.27  for  F(t)  =  t:  only  the  notation  here  is 


different. 


We  next  give  a  generalization  of  Theorem  35.13.  The  proof  is 
somewhat  complicated  and  uses  Corollary  35.28.  It  was  originally 
worked  out  by  me  and  my  colleague  Theodore  W.  Palmer. 

35.29  Theorem. 

Suppose  F  is  differentiable  on  [a,  b]  and  F'  is  Riemann  integrable  on 
[i a,b ].  A  bounded  function  f  on  [a,b\  is  F -integrable  if  and  only  if 
fF'  is  Riemann  integrable,  in  which  case 


We  will  give  the  proof  after  Lemma  35.30  and  its  corollary. 
First  look  at  Definition  35.2  on  page  300.  Being  differentiable,  F  is 
continuous.  So  the  Jf  terms  in  the  definition  are  0,  and  we  have 


n 


UF(f,P)  =  J2M(f’  Vk-utk))  '  [F(tk)-F(tk- 1)] 


k= 1 


and 


n 


LF(f,P)  =  X] m(f ,  (4-1,4))  •  [F(tk)  -  F(4-i)]. 


k= 1 


We  will  use  these  formulas  in  the  proof  of  Lemma  35.30  below.  We 
also  use  the  notation  U^(f),  etc.,  from  Corollary  35.28. 
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35.30  Lemma. 

Assume  F  is  differentiable  on  [ a,b\ ,  F'  is  Riemann  integrable  on 
[a,  b],  and  f  is  a  bounded  function  on  [a,  b] .  Let  B  be  a  positive  bound 
for  \f\.  If  we  have  Ub(F',P)  —  l){fF'  ,P)  <  e/B,  then 

\UF(f,P)-U\fF',P)\<e  (1) 


and 


\LF(f,P)-L\fF',P)\<e.  (2) 

Proof 

Let  P  =  {a  =  to  <  t\  <  ■  ■  ■  <  tn  =  b}.  By  the  Mean  Value 
Theorem  29.3,  for  each  k  there  exists  xk  in  (4—1,4)  so  that 


F(tk)  ~  F{tk- 1)  =  F'{xk)  ■  (4  -  4-0-  (3) 


Now  consider  an  arbitrary  yk  in  (4-1,4)  and  observe 

n 

J2  \F'^  ~  F'^\  ■  fa  -  ^-i)  ^  U^F^  fa  -  Lb(F'’ p)  <  |  (4) 

k= 1 

since  the  sum  is  bounded  by  E/EJM^F',  (4-1,4)) 
—  m{F' ,  (4-i,4))]  ’  (4  —  4-i).  Applying  this  and  (3),  we  obtain 

I  ELi  f{Vk)[F(tk)  -  F(tk-i)]  -  ELi  / (2/fc)  '  F'iVk)  ■  (4  -  4-i)| 

=  I  ELi  f(Vk)  ■  F'(xk )  •  (4  -  4-i)  -  ELi  f(Vk)  ■  F'iVk)  ■  (4  -  4-i)| 

<  Efc=i 1/6/01  ■  I F'{xk)  -  F'{yk) |  •  (4  -  4-i) 

<  B  '  ELi  |F’,(a:fc)  —  F^Cj/OI  '  (4  —  4-i)  <  e. 

Therefore  for  yk  in  (4—1,4),  we  have 

ELi  /(y0[P(4)  -  p(4-i)]<e+  ELi  /(y0  •  P'(y0  ■  (4  -  4-0 

<  C  +  ELi  M(fF',  (4-1,4))  •  (4  -  4-0  =  €  +  4b(/4',  P) 

(5) 

and 

ELi  /(y0  •  F'{yk)  •  (4  -  4-0<e  +  ELi  /(yfc)[P(4)  -  p(4-0] 

<  e  +  ELi  M(0  (4-i,4))[P(4)  -  P(4-0]  =  e  +  UF(f,  P). 


(6) 
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Since  (5)  and  (6)  hold  for  arbitrary  in  (4-1,4),  for  each  k,  we 
conclude4 

n 

UF{f,  P)  =  J2  M(f ,  (4-1,4))  •  [F(tk)  —  F(tk-i)]  <e  +  U\fF',P). 

k= l 

(7) 

and 

n 

u\fF ',  P)  =  J2  MUF',  (4-i,4))  •  (4  - 4-i)  <  e  +  UF(f,  P).  (8) 

k= l 

Now  (1)  follows  from  (7)  and  (8);  (2)  has  a  similar  proof.  ■ 

35.31  Corollary. 

With  F  and  f  as  in  Lemma  35.30,  we  have  UF(f)  =  U(fF')  and 
LF(f)  =  L(fFf). 

Proof 

Consider  e  >  0.  Select  partitions  Pi  and  P2  of  [o,  b]  so  that 

|C/H/,A)-£M/)|<e  and  \U{fF')  -  U\fF',  P2)|  <  e. 

Such  a  partition  P2  exists  because  U(fF')  =  U^(fF')  by  Corol¬ 
lary  35.28.  Since  F'  is  Riemann  integrable  by  hypothesis,  U^(F')  = 
U(F')  =  L(F')  =  L}’{F').  So  there  exists  a  partition  P3  so  that 

U\F',P3)-L\F',P3)<e/B. 

The  last  three  inequalities  still  hold  if  we  replace  Pi ,  P2 ,  P3  by  a 
common  refinement  P.  Now  by  Lemma  35.30,  we  have 

|PF(/,P)-Pb(/P',P)|  <e, 

so  by  the  triangle  inequality,  we  have 

\UF(f)-U(fF')\<3e. 

Since  e  is  arbitrary,  UF(f)  =  U(fF').  Likewise  LF(f)  =  L(fF').  ■ 


4 Some  readers  may  appreciate  more  explanation.  To  avoid  breaking  the  flow  of 
the  proofs,  this  will  be  provided  after  the  proof  of  Theorem  35.29  is  completed. 
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Proof  of  Theorem  35.29 

Suppose  /  is  F-integrable.  Then  UF(f )  =  LF{f).  Hence  U(fF')  = 
L(fF')  by  Corollary  35.31.  Thus  fF'  is  Riemann  integrable  and 

I'  fdF  =  UF(f)  =  U {fF1)  =  f  f(x)F'(x)dx. 

J  a  J  a 

Now  suppose  fF'  is  Riemann  integrable.  Then  U(fF')  =  L(fF' ); 
hence  UF(f )  =  LF(f).  Thus  /  is  F-integrable  and 

[b  f{x)F'{x)dx  =  U  {fF')  =  UF(f)  =  I'  fdF. 

J  a  J  a  m 


How  did  we  so  quickly  conclude  inequalities  (5)  and  (6)  in 
Lemma  35.30?  Intuitively,  we  knew  we  could  select  each  y so  that 
f{yk)  is  very  close  to  M (/,  (tk~i,tk)),  which  appears  in  the  definition 
of  UF(f,P )  given  after  the  statement  of  Theorem  35.29.  Similarly, 
we  concluded  inequality  (6)  because  we  could  select  each  so  that 
( fF')(yk )  is  very  close  to  M(fF',  ifc)),  which  appears  in  the 
definition  of  U^(fF',P).  In  fact,  these  conclusions  follow  from  the 
following  lemma. 

35.32  Lemma. 

Suppose  ai, . . . ,  an  are  (fixed)  nonnegative  numbers  and  B\, ... ,  Bn 
are  nonempty  bounded  subsets  o/M.  If  for  some  constant  K,  we  have 

n 

k= 1 

for  all  choices  of  bk  in  B k,  k  =  1,2, ...  ,n,  then 

n 

yj  O  k  sup  Bk  <  K. 
k= 1 

Proof 

We  prove  the  following  by  induction  on  m  =  1,2, ...  ,n: 

m—  1  n 

Pm  :  uambm  <K~y  ak  sup  Bk  -  ^  akbk, 

k=  1  k=m-\- 1 


Exercises  329 


for  all  choices  of  bk  in  Bk,  k  =  m, . . . ,  n.”  As  always,  sums  and 

'Y!k=n+ 1  are  taken  to  be  0.  Assertion  P\  holds  by  the  hypothesis  of 
the  lemma.  Assume  Pm  holds  for  some  m  =  1 , ,n  —  1.  Since  bm 
in  Bm  is  arbitrary,  Pm  implies 

m—  1  n 

Qm  :  uam  sup  Bm  <  K  -  ^  ak  sup  Bk  -  ^  akbk, 

k=  1  k=m-\- 1 

for  all  choices  of  bk  in  Bk,  k  =  m  +  1, . . .  ,  to,”  but  this  is  exactly 
assertion  Pm+ 1-  By  induction,  all  Pn  and  Qn  hold.  Since  Qn  is  the 
conclusion  of  the  lemma,  the  proof  is  complete.  ■ 

The  nontrivial  part  of  Exercise  4.14,  sup  A  +  sup  B  <  sup(A  +  £>), 
is  a  special  case  of  Lemma  35.32  where  n  =  2,  ai  =  a2  =  1,  B\  =  A, 
h>2  =  B ,  and  K  =  sup(A  +  B). 

Exercise  35.6  asserts  j ^  fdF  =  lim^^oo  J ^  fndF  provided  the 
sequence  ( fn )  of  E-integrable  functions  converges  uniformly  to  /  on 
[a,  6].  Moreover,  all  of  the  comments  in  Discussion  33.10  carry  over 
to  this  setting. 


Exercises 

35.1  Let  F  be  an  increasing  function  on  [a,  b }. 

(a)  Show  lim-^t-  F( x)  exists  for  t  in  (a,  b\  and  is  equal  to  sup{E(x)  : 
x  S  (a, t)}. 

(b)  Show  lim2,_>t+  F{x)  exists  for  t  in  [a,  b)  and  is  equal  to  inf{F(x)  : 
x  G  (; t ,  6)}. 

35.2  Calculate  /Q3  x2  dF{x)  for  the  function  F  in  Example  4. 

35.3  Let  F  be  the  step  function  such  that  F(t)  =  n  for  t  G  [n,n  +  1),  n 
an  integer.  Calculate 

(a)  /Q6  xdF(x),  (b)  /3  x2  dF{x), 

(c)  flit  x2dF{ x). 

35.4  Let  F{t)  =  sint  for  4  G  [-|,|].  Calculate 

(a)  ff/2xdF(x )  (b)  Hi2/ 2xdF(x)- 


330  ®'  Integration 


35.5  Let  /( x)  =  1  for  rational  x  and  f(x)  =  0  for  irrational  x. 

(a)  Show  that  if  F  is  continuous  on  [a,  b]  and  F(a)  <  F(b ),  then  / 
is  not  F-integrable  on  [a,  b ]. 

(b)  Observe  /  is  F-integrable  if  F  is  as  in  Example  1  or  3. 


35.6  Let  (/„)  be  a  sequence  of  F-integrable  functions  on  [a,  b],  and  suppose 
fn—>f  uniformly  on  [a,  b].  Show  /  is  F-integrable  and 


f  dF  =  lim 

n—too 


fndF. 


35.7  Let  /  and  g  be  F-integrable  functions  on  [a,  b ].  Show 

(a)  f2  is  F-integrable. 

(b)  fg  is  F-integrable. 

(c)  max(/,  g)  and  min(/,  g)  are  F-integrable. 


35.8  Let  g  be  continuous  on  [a,  b\  where  g(x)  >  0  for  all  x  £  [a,  b]  and 
define  F(t)  =  f^g(x)dx  for  t  S  [a,b].  Show  that  if  /  is  continuous, 
then 


f(x)g(x)dx. 


35.9  Let  /  be  continuous  on  [a,b]. 

(a)  Show  f  dF  =  f(x)[F(b)  —  F(a)]  for  some  x  in  [a,  b\. 

(b)  Show  Exercise  33.14  is  a  special  case  of  part  (a). 


35.10  Let  F(x)  =  f(x)  =  xn  for  x  £  [a,  b]  and  some  positive  odd  integer  n. 
Show  J*fdF=  \[b2n-a2n]. 

35.11  Here  is  a  “change  of  variable”  formula.  Let  /  be  F-integrable  on  [a,  b]. 
Let  0  be  a  continuous,  strictly  increasing  function  on  an  interval  [c,  d] 
such  that  =  a  and  cj>(d)  =  b.  Define 


g(u)  =  f  (</>(«))  and  G(u)  =  F(cj)(u))  for  u£[c,d\. 

Show  g  is  G-integrable  and  J ^  g  dG  =  J ^  f  dF. 

35.12  Let  (uj)  be  an  enumeration  of  the  rationals  in  [a,  b]  and  let  (c.j )  be  a 
sequence  of  positive  integers  such  that  J2cj  <  00  ■ 


(a)  Show  F  =  CjJuj  defines  a  strictly  increasing  function  on  [a,  b ]. 

(b)  At  what  points  is  F  continuous? 


§36.  *  Improper  Integrals  331 


§36  *  Improper  Integrals 

The  Riemann  integral  in  §32  has  been  defined  only  for  functions  that 
are  bounded  on  a  closed  interval  [a,b\.  It  is  convenient  to  be  able  to 
integrate  some  functions  that  are  unbounded  or  are  defined  on  an 
unbounded  interval. 


36.1  Definition. 

Consider  an  interval  [a,  b)  where  b  is  finite  or  Too.  Suppose  /  is  a 
function  on  [a,  b)  that  is  integrable  on  each  [a,  d]  for  a  <  d  <  6,  and 
suppose  the  limit 


lim  /  f  (x)  dx 

d^b-  Ja 

exists  either  as  a  finite  number,  Too  or  —  oo.  Then  we  define 

/b  pd 

f(x)  dx  =  lim  /  f{x)  dx. 


(1) 


If  b  is  finite  and  /  is  integrable  on  [a,  b],  this  definition  agrees  with 
that  in  Definition  32.1  [Exercise  36.1].  If  b  =  +oo  or  if  /  is  not 
integrable  on  [a,b],  but  the  limit  in  (1)  exists,  then  (1)  defines  an 
improper  integral. 

An  analogous  definition  applies  if  /  is  defined  on  (a,  b\  where  a  is 
finite  or  — oo  and  if  /  is  integrable  on  each  [c,  b ]  for  a  <  c  <  b.  Then 
we  define 


f(x)dx=  lim  /  f{x)dx 


(2) 


whenever  the  limit  exists. 

If  /  is  defined  on  (a,  b)  and  integrable  on  all  closed  subintervals 
[c,  d],  then  we  fix  a  in  (a,  b)  and  define 


'  pcx.  rb 

f(x)dx=  /  f(x)dx+  /  f(x)dx 

J  a  J  a 


(3) 


provided  the  integrals  on  the  right  exist  and  the  sum  is  not  of  the 
form  Too  T  (— oo).  Here  we  agree  oo  +  L  =  ooifL^  — oo  and 
(— oo)  T  L  =  — oo  if  L  ^  oo.  It  is  easy  [Exercise  36.2]  to  see  this 
definition  does  not  depend  on  the  choice  of  a. 
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Whenever  the  improper  integrals  defined  above  exist  and  are 
finite,  the  integrals  are  said  to  converge.  Otherwise  they  diverge  to 
+oo  or  to  —  oo. 


Example  1 

Consider  f(x)  =  ~  for  x  €  (0,  oo).  For  d  >  1,  we  have  ff  '  dx  = 
loged,  so 


r°°  l 

/  ~  dx  =  lim  loge  d  =  +oo. 

J1  X  d — ^oo 

This  improper  integral  diverges  to  Too.  For  0  <  c  <  1,  we  have 

fc  x  dx  =  ~  loSe  c>  so 

/•>  1 

/  —  dx  =  lim  [—  log„  cl  =  +oo. 

Jo  x  o+L 


Also  we  have 


r °  i 

/  -  =  +oo. 

Jo  X 


□ 


Example  2 

Consider  f(x)  =  x~p  for  x  £  [l,oo)  and  a  fixed  positive  number 
p  1 .  For  d  >  1 , 


J\~p  dx  = 


It  follows  that 


1  1 

x  p  dx  =  - [0  —  1]  =  -  if  p  >  1 

1  —  p  p  —  1 


and 


j; 


x  p  dx  =  Too  if  0  <  p  <  1 . 


□ 


Example  3 

We  have  f  ^  sin  xdx  =  1— cos  d  for  all  d.  The  value  (1— cos  d)  oscillates 
between  0  and  2,  as  d  — >  oo,  and  therefore  the  limit 

fd 

lim  /  sin  xdx  does  not  exist. 

d~^°°  Jo 
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Thus  the  symbol  sin  x  dx  has  no  meaning  and  is  not  an  improper 
integral.  Similarly,  f0^  sin  x  dx  and  f^°  sin  x  dx  have  no  meaning. 
Note  the  limit 


r 

lim  /  sin  x  dx 

a—>  oo  /  „ 

J  —a 


clearly  exists  and  equals  0.  When  such  a  “symmetric”  limit  ex¬ 
ists  even  though  the  improper  integral  does  not,  we  have 

what  is  called  a  Cauchy  principal  value  of  .  Thus  0  is  the 
Cauchy  principal  value  of  sin  xdx,  but  this  is  not  an  improper 
integral.  □ 


It  is  especially  valuable  to  extend  Riemann-Stieltjes  integrals  to 
infinite  intervals;  see  the  discussion  after  Theorem  36.4  below.  Let  F 
be  a  bounded  increasing  function  on  some  interval  /.  The  function 
F  can  be  extended  to  all  of  1  by  a  simple  device:  if  I  is  bounded 
below,  define 


F(t)  =  inf {F(u)  :ii£/}  for  t  <  inf  /; 

if  I  is  bounded  above,  define 

F(t)  =  sup {F(u)  :  u  £  1}  for  t  >  sup  I. 

For  this  reason,  we  will  henceforth  assume  F  is  an  increasing  function 
on  all  of  M.  We  will  use  the  notations 

F(— oo)  =  lim  F(t)  and  F( oo)  =  lim  F(t). 

t—>— oo  t—>  OO 

Improper  Riemann-Stieltjes  integrals  are  defined  in  analogy  to 
improper  Riemann  integrals. 

36.2  Definition. 

Suppose  /  is  T-integrable  on  each  interval  [a,  b]  in  K.  We  make  the 
following  definitions  whenever  the  limits  exist: 
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If  both  limits  exist  and  their  sum  does  not  have  the  form  oo  +  (—00), 
we  define 


If  this  sum  is  finite,  we  say  /  is  .F-integrable  on  R.  If  /  is  -F-integrable 
on  R  for  F(t)  =  t  [i.e. ,  the  integrals  are  Riemann  integrals],  we  say 
/  is  integrable  on  R. 

36.3  Theorem. 

If  f  is  F -integrable  on  each  interval  [a,b]  and  if  f(x)  >  0  for  all 
rgR,  then  f  is  F -integrable  on  R  or  else  f  dF  =  +00. 

Proof 

We  indicate  why  lim^-Qc  Jf;°  f  dF  exists,  and  leave  the  case  of 
lirn^oo  Jq  f  dF  to  the  reader.  Let  h{a )  =  Ja°  f  dF  for  a  <  0,  and  note 
a'  <  a  <  0  implies  h(a')  >  h(a).  This  property  implies  linia^-oo  h(a) 
exists  and 


lim  h(a)  =  sup{h(a)  :  a  G  (— 00,  0)}. 


We  omit  the  simple  argument. 


36.4  Theorem. 

Suppose  —00  <  F(— 00)  <  F(oo)  <  00.  Let  f  be  a  bounded  func¬ 
tion  on  R  that  is  F -integrable  on  each  interval  [a,  b] .  Then  f  is 
F -integrable  on  R. 


Proof 


Select  a  constant  B  such  that  \f(x)\  <  B  for  all  x  G  R.  Since  we 
have  F{oo)—F{—oo)  <  00,  constant  functions  are  F-integrable.  Since 
0  <  f+B  <  2 B,  Theorem  36.3  shows  f+B  is  F-integrable.  It  follows 
[Exercise  36.10]  that  /  =  (/  +  B)  +  (— B)  is  also  F-integrable.  ■ 

Increasing  functions  F  defined  on  R  come  up  naturally  in  prob¬ 
ability  and  statistics.  In  these  disciplines,  F  is  called  a  distribution 
function  if  we  also  have  F(— 00)  =  0  and  F( 00)  =  1.  Of  course, 
the  function  F(t)  =  t  that  corresponds  to  the  Riemann  integral 
is  not  a  distribution  function.  Here  is  how  a  distribution  function 
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comes  up  in  probability.  Consider  a  random  experiment  with  numer¬ 
ical  outcomes;  then  F(t)  can  represent  the  probability  the  numerical 
value  will  be  <  t.  Thus  F  will  be  right  continuous.  As  a  very  simple 
example,  suppose  the  experiment  involves  tossing  three  fair  coins 
and  counting  the  number  of  heads.  The  numerical  values  0,  1,  2, 
and  3  will  result  with  probabilities  |,  |,  and  respectively.  The 
corresponding  distribution  function  is  defined  in  Example  2  of  §35, 
page  303,  and  sketched  in  Fig.  35.1. 

Frequently  a  distribution  function  F  has  the  form 

F(t)  =  f  g{x)dx 
J  —  OO 


for  an  integrable  function  g  satisfying  g{x)  >  0  for  all  i£l.  Then 
g  is  called  a  density  for  F.  Note  we  must  have 

POO 


g{x)  dx  =  1. 


If  g  is  continuous,  then  g(t)  =  F'(t)  for  all  t  by  Theorem  34.3. 


Example  4 

It  turns  out  that  e~x  dx  =  i/lr  [Exercise  36.7]  and  hence 


e  dx  =  V/27 r. 


The  most  important  density  in  probability  is  the  normal  density 


g(x)  = 


,-z2/2 


which  gives  rise  to  the  normal  distribution 

pt 


e~x  /2  dx: 


see  Fig.  36.1. 


□ 


Exercises  36.1-36.8  below  deal  only  with  Riemann  integrals. 


336  ®'  Integration 


y 


FIGURE  36.1 


Exercises 


36.1  Show  that  if  /  is  integrable  on  [a,  6]  as  in  Definition  32.1,  then 

fb 

dx~  f(x)  dx. 

J  a 

36.2  Show  the  definition  (3)  in  Definition  36.1  does  not  depend  on  the 
choice  of  a. 


36.3  (a)  Show 


Jo 


~pdx  = 


1  ~P 


if  0  <  p  <  1  and 


f 

Jo 


x  p  dx  =  +oo  if  p  >  1. 


(b)  Show  J0°°  x  p  dx  =  — f-oo  for  all  p  >  0. 


36.4  Calculate 

(a)  fo  loSe  x  dx,  (b)  /2°°  dx, 

(c)  fo°°  dx- 

36.5  Let  /  be  a  continuous  function  on  (a,  b)  such  that  f(x)  >  0  for  all 
x  £  (a,  b);  a  can  be  —  oo,  b  can  be  +oo.  Show  the  improper  integral 
f  f(x)  dx  exists  and  equals 


SUP  S  /  f(x)  dx  :  [c,  d]  C  (a,  b) 


36.6  Prove  the  following  comparison  tests.  Let  /  and  g  be  continuous  func¬ 
tions  on  (a,  b)  such  that  0  <  f(x)  <  g{x)  for  all  x  in  (a,  b );  a  can  be 
— oo,  b  can  be  +oo. 
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(a)  If  g(x)dx  <  oo,  then  f^  f(x)dx  <  oo. 

(b)  If  f^  f{x)  dx  =  +oo,  then  f^g(x)  dx  =  +oo. 

36.7  (a)  Use  Exercise  36.6  to  show  ///  e~x2  dx  <  oo. 

(b)  Show  this  integral  equals  ^/tv.  Hint :  Calculate  the  double  integral 
f^oo  e~x  e~v  dx  dy  using  polar  coordinates. 

36.8  Suppose  /  is  continuous  on  (a,  b)  and  f ^  \f(x)\  dx  <  oo;  again  a  can 

be  —oo,  b  can  be  +oo.  Show  the  integral  f ^  f{x)  dx  exists  and  is 

finite. 

36.9  Let  F  be  the  normal  distribution  function  in  Example  4. 

(a)  Show  that  if  /  is  continuous  on  R  and  if  the  improper  integral 
ff°  f(x)e~x  Z2  dx  exists,  then  the  improper  integral  ff°  f  dF 
exists  and 


/OO  1  f-OO 

f  dF  =  _  /  f(x)e~x^dx. 

sF^J-  oo 


Calculate 

(b)  fZo^dFix), 

(d)  f-oo  \x\dF(x), 


(c)  IZ 


''  dF(x), 


(e)  JZoxdF(x)- 


36.10  Let  /  and  g  be  F-integrable  functions  on  R.  Show  f+g  is  F-integrable 
on  R  and 

fOO 


/OO  fOO  /*  oo 

(/  +  9)  dF  =  /  fdF+  gdF. 

-oo  J—  oo  J—  oo 


36.11  Show  that  if  f  and  a  are  F-integrable  on  R  and  if  fix)  <  q(x)  for  x 
in  R,  then/00  /  dF  <  f°°  gdF. 

36.12  Generalize  Exercise  36.6  to  F-integrals  on  R. 

36.13  Generalize  Exercise  36.8  to  F-integrals  on  R. 

36.14  Let  (uj )  be  a  sequence  of  distinct  points  in  R,  and  let  (cj)  be  a 
sequence  of  nonnegative  numbers  such  that  Jfcj  <  oo. 

(a)  Observe  F  =  CjJUj  is  an  increasing  function  on  R.  See 

Example  3  on  page  309. 

(b)  Show  every  bounded  function  /  on  R  is  E-integrable  and 


r 

J  —  c 


fdF  =  J2cjf(uj). 
’  3=1 
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(c)  When  will  F  be  a  distribution  function? 

(d)  As  in  Exercise  35.12,  if  ('Uj)  is  an  enumeration  of  the  rationals, 
then  F  is  strictly  increasing  on  R. 

36.15  (a)  Give  an  example  of  a  sequence  (/„)  of  integrable  functions  on 
R  where  f  fn  ( x )  dx  =  1  for  all  n  and  yet  /„  — >  0  uniformly 

on  R. 


(b)  Suppose  F  is  a  distribution  function  on  R.  Show  that  if  (/„)  is  a 
sequence  of  F-integrable  functions  on  R  and  if  /„—>■/  uniformly 
on  R,  then  /  is  F-integrable  on  R  and 


lim 

n—>  oo 


dF. 
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CHAPTER 


§37  *  A  Discussion  of  Exponents 

and  Logarithms 

In  this  book  we  have  carefully  developed  the  theory,  but  have  been 
casual  about  using  the  familiar  exponential,  logarithmic  and  trigono¬ 
metric  functions  in  examples  and  exercises.  Most  readers  probably 
found  this  an  acceptable  approach,  since  they  are  comfortable  with 
these  basic  functions.  In  this  section,  we  indicate  three  ways  to  de¬ 
velop  the  exponential  and  logarithmic  functions  assuming  only  the 
axioms  in  Chap.  1  and  the  theoretical  results  in  later  chapters.  We 
will  provide  proofs  for  the  third  approach. 

Recall,  for  x  in  M  and  a  positive  integer  n,  xn  is  the  product  of 
x  by  itself  n  times.  For  x  ^  0,  we  have  the  convention  x°  =  1.  And 
for  and  negative  integers  —  n  where  n  £  N,  we  define  x~n  to 

be  the  reciprocal  of  xn ,  i.e. ,  x~n  =  (xn)_1. 


37.1  Piecemeal  Approach. 

This  approach  starts  with  Example  2  on  page  238  and  Exercise  29.15 
where  it  is  shown  that  xr  is  meaningful  whenever  x  >  0  and  r  is 
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rational,  i.e. ,  r  G  Q.  Moreover, 

if  h(x)=xr,  then  h>(x)=rxr~1. 

The  algebraic  properties  xrxs  =  xr+s  and  ( xy)r  =  xryr  can  be  veri- 
hed  for  r,  s  G  Q  and  positive  x  and  y.  For  any  t  G  M  and  x  >  0,  we 
define 

xt  =  sup{xr  :  r  €  Q  and  r  <  t} 


and 


This  defines  x1  for  x  >  0.  It  can  be  shown  that  with  this  definition 
xl  is  finite  and  the  algebraic  properties  mentioned  above  still  hold. 
Further,  it  can  be  shown  that  h(x)  =  xt  is  differentiable  and  h'(x)  = 
txl~} . 

Next  we  can  consider  a  fixed  b  >  0  and  the  function  B  defined  by 
B(x)  =  bx  for  i£l.  The  function  B  is  differentiable  and  B'(x)  = 
CbB(x)  for  some  constant  q, .  We  elaborate  on  this  last  claim.  In  view 
of  Exercise  28.14,  we  can  write 


B'{x) 


jjX+h  _  fox 

lim - - - 

h — >0  h 


bx  •  lim 

/i->  o 


bh  -  1 
h 


provided  these  limits  exist.  Some  analysis  shows  that  the  last  limit 
does  exist,  so 

B'{x)  =  CbB(x)  where  q,  =  lim  \  [bh  —  1], 

/i— >-o  h 


It  turns  out  that  q,  =  1  for  a  certain  b,  known  universally  as  e. 
Since  B  is  one-to-one  if  6  ^  1,  B  has  an  inverse  function  L  which 
is  named  L(y)  =  log by-  Since  B  is  differentiable,  Theorem  29.9  on 
page  237  can  be  applied  to  show  L  is  differentiable  and 


L\y) 


l 

Cby' 


Finally,  the  familiar  properties  of  logb  can  be  established  for  L.  □ 


When  all  the  details  are  supplied,  the  above  approach  is  very 
tedious.  It  has  one,  and  only  one,  merit;  it  is  direct  without  any 


§37.  *  A  Discussion  of  Exponents  and  Logarithms  341 


tricks.  One  could  call  it  the  “brute  force  approach.”  The  next  two 
approaches  begin  with  some  well  defined  mathematical  object  [either 
a  power  series  or  an  integral]  and  then  work  backwards  to  develop  the 
familiar  properties  of  exponentials  and  logarithms.  In  both  instances, 
for  motivation  we  will  draw  on  more  advanced  facts  we  believe  but 
which  have  not  been  established  in  this  book. 


37.2  Exponential  Power  Series  Approach. 

This  approach  is  adopted  in  two  of  our  favorite  books:  [16,  §4.9] 
and  [62,  Chap.  8].  As  noted  in  Example  1  of  §31,  we  believe 


e 


X 


oo 


E 


though  we  have  not  proved  this,  since  we  have  not  even  defined 
exponentials  yet.  In  this  approach,  we  define 


E(x ) = £ 


k= 0 


(1) 


and  we  define  e  =  E{  1).  The  series  here  has  radius  of  convergence 
Too  [Example  1,  §23],  and  E  is  differentiable  on  M  [Theorem  26.5]. 
It  is  easy  [Exercise  26.5]  to  show  E'  =  E.  The  fundamental  property 


E(x  +  y)  =  E(x)E(y) 


(2) 


can  be  established  using  only  the  facts  observed  above.  Actually  [62] 
uses  a  theorem  on  multiplication  of  absolutely  convergent  series, 
but  [16]  avoids  this.  Other  properties  of  E  can  be  quickly  established. 
In  particular,  E  is  strictly  increasing  on  M  and  has  an  inverse  L.  The¬ 
orem  29.9  on  page  237  assures  us  L  is  differentiable  and  L'(y )  = 
For  rational  r  and  x  >  0,  xr  was  defined  in  Exercise  29.15.  Applying 
that  exercise  and  the  chain  rule  to  g(x)  =  L(xr)  —  rL(x),  we  find 
g'{x )  =  0  for  x  >  0.  Hence  g  is  a  constant  function.  Since  g(l)  =  0, 
we  conclude 


L(xr )  =  rL(x)  for  reQ  and  x  >  0. 
For  b  >  0  and  rational  r,  (3)  implies 

br  =  E(L(br ))  =  E(rL(b)). 


(3) 
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Because  of  this,  we  define 

bx  =  E(xL(b ))  for 

The  familiar  properties  of  exponentials  and  their  inverses  [loga¬ 
rithms!]  are  now  easy  to  prove.  □ 

The  choice  between  the  approach  just  outlined  and  the  next  ap¬ 
proach,  which  we  will  present  in  some  detail,  is  really  a  matter  of 
taste  and  depends  on  the  appeal  of  power  series.  One  genuine  ad¬ 
vantage  to  the  exponential  approach  is  that  the  series  in  (1)  defining 
E  is  equally  good  for  defining  E(z)  =  ez  for  complex  numbers  2. 

37.3  Logarithmic  Integral  Approach. 

Let  us  attempt  to  solve  f  =  /  where  /  never  vanishes;  we  expect 
to  obtain  E{x)  =  ex  as  one  of  the  solutions.  This  simple  differential 
equation  can  be  written 

f 

7  =  1'  (1) 

In  view  of  the  chain  rule,  if  we  could  find  L  satisfying  L'  (y)  =  -, 
then  Eq.  (1)  would  simplify  to 

(W)'  =  1, 

so  one  of  the  solutions  would  satisfy 

Lof(y)  =  y. 

In  other  words,  one  solution  /  of  (1)  would  be  an  inverse  to  L  where 
L'{y )  =  -  But  by  the  Fundamental  Theorem  of  Calculus  II  [Theo¬ 
rem  34.3  on  page  294],  we  know  such  a  function  L  exists.  Since  we 
also  expect  L{  1)  =  0,  we  define 

L(y)  =  j  j  dt  for  y  £  (0,  oo). 


We  use  this  definition  to  prove  the  basic  facts  about  logarithms  and 
exponentials.  □ 
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37.4  Theorem. 

(i)  The  function  L  is  strictly  increasing,  continuous  and  differen¬ 
tiable  on  (0,oo).  We  have 

L'(y)  =  ~  for  y  €  (0,  oo). 

y 

(ii)  L(yz )  =  L(y )  +  L(z)  for  y,z£  (0,  oo). 

(iii)  L(f )  =  L(y )  -  L(z )  for  y,z£  (0,  oo). 

(iv)  lim^oo  L(y)  =  +oo  and  lim?;_>.0+  L(y)  =  -oo. 

Proof 

It  is  trivial  to  show  the  function  f(t)=t  is  continuous  on  M,  so  its 
reciprocal  )  is  continuous  on  (0,  oo)  by  Theorem  17.4.  It  is  easy  to 
see  L  is  strictly  increasing,  and  the  rest  of  (i)  follows  immediately 
from  Theorem  34.3. 

Assertion  (ii)  can  be  proved  directly  [Exercise  37.1].  Alterna¬ 
tively,  fix  2  and  consider  g(y)  =  L(yz )  —  L(y)  —  L(z).  Since  g(l)  =  0, 
it  suffices  to  show  g'(y )  =  0  for  y  6  (0,  oo)  [Corollary  29.4],  But  since 
z  is  fixed,  we  have 


To  check  (iii),  note  L(^)  +  L(z)  =  L(~  ■  z)  =  L{  1)  =  0,  so  that 
L(\)  =  -L(z)  and 

L  (-)  =  L  (y  ■  ^  =  L(y)  +L  Q  j  =  L(y)  -  L(z). 

To  see  (iv),  first  observe  L( 2)  >  0  and  L{ 2n)  =  n  ■  L( 2)  in  view 
of  (ii).  Thus  lim^oo  L(2n)  =  +oo.  Since  L  is  increasing,  it  follows 
that  liniy^oo  L(y)  =  +oo.  Likewise  L(|)  <  0  and  L((^)n)  =  n-  L(^), 
so  lim^0+  L(y)  =  -oo.  ■ 


The  Intermediate  Value  Theorem  18.2  on  page  134  shows  L  maps 
(0,  oo)  onto  M.  Since  L  is  a  strictly  increasing  function,  it  has  a 
continuous  strictly  increasing  inverse  [Theorem  18.4  on  page  137] 
and  the  inverse  has  domain  M. 
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37.5  Definition. 

We  denote  the  function  inverse  to  L  by  E.  Thus 
E(L(y))=y  for  2/e(0,oo) 

and 


L(E(x ))  =  x  for  ieK. 
We  also  define  e  =  E(  1)  so  that  fi  jdt  =  1. 


37.6  Theorem. 

(i)  The  function  E  is  strictly  increasing,  continuous  and  differen¬ 
tiable  on  R.  Then 


E'(x)  =  E{x)  for  i£l. 

(ii)  E(u  +  v)  =  E(u)E(v)  for  u,  v  €  R. 

(iii)  lim^oo  E(x)  =  +oo  and  lim-j-^oo  E(x)  =  0. 


Proof 

All  of  (i)  follows  from  Theorem  37.4  in  conjunction  with  Theo¬ 
rem  29.9  on  page  237.  In  particular, 


E'(x) 


1 

L'(E(x)) 


1 

i 

E(x) 


E{x). 


If  u,  v  €  R,  then  u  =  L(y )  and  v  =  L(z)  for  some  y,z  E  (0,oo). 
Then  u  +  v  =  L(yz )  by  (ii)  of  Theorem  37.4,  so 


E(u  +  v)  =  E(L(yz))  =  yz  =  E(L(y))E(L(z))  =  E(u)E(v). 


Assertion  (iii)  follows  from  (iv)  of  Theorem  37.4  [Exercise  37.2].  ■ 


Consider  b  >  0  and  r  6  Q,  say  r  =  where  m,n  G  Z  and 
n  >  0.  It  is  customary  to  write  br  for  that  positive  number  a  such 
that  a 71  =  bm.  By  (ii)  of  Theorem  37.4,  we  have  nL(a )  =  mL(b ); 
hence 

br  =  a  =  E(L(a))  =  E[-n 

\n 

This  motivates  our  next  definition  and  also  shows  the  definition  is 
compatible  with  the  usage  of  fractional  powers  in  algebra. 


L(a )  )  =E  (  -  •  mL{b)  )  =  E{rL{b)). 
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37.7  Definition. 

For  b  >  0  and  x  in  M,  we  define 

bx  =  E{xL(b)). 

Since  L(e)  =  1,  we  have  ex  =  E(x )  for  all 

37.8  Theorem. 

Fix  b  >  0. 

(i)  The  function  B{x)  =  bx  is  continuous  and  differentiable  onR. 

(ii)  If  b  >  1,  then  B  is  strictly  increasing;  if  b  <  1,  then  B  is 
strictly  decreasing. 

(iii)  Ifbf^l,  then  B  maps  M  onto  (0,oo). 

(iv)  bu+v  =  bubv  for  ii^el 

Proof 

Exercise  37.3.  ■ 

If  b  ^  1,  the  function  B  has  an  inverse  function. 

37.9  Definition. 

For  b  >  0  and  b  1,  the  inverse  of  B(x)  =  bx  is  written  logfe.  The 
domain  of  log6  is  (0,  oo)  and 

log by  =  x  if  and  only  if  bx  =  y. 

Note  loge  y  =  L(y )  for  y  >  0. 

37.10  Theorem. 

Fix  b  >  0,  b  7^  1. 

(i)  The  function  log6  is  continuous  and  differentiable  on  (0,oo). 

(ii)  If  b  >  1,  logfe  is  strictly  increasing ;  if  b  <  1,  logb  is  strictly 
decreasing. 

(iii)  log b(yz)  =  logby  +  logbz  fory,z  <E  (0,oo). 

(iv)  logfe(f)  =  log by-  log bz  for  y,z  €  (0,oo). 

Proof 

This  follows  from  Theorem  37.4  and  the  identity  log by  = 
[Exercise  37.4],  Note  L(b)  is  negative  if  b  <  1.  ■ 
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The  function  E{x)  =  ex  has  now  been  rigorously  developed  and, 
as  explained  in  Example  1  of  §31,  we  have 

o° 

E w  =  E 

k= 0 

In  particular,  e  =  XlfcLo  Also 

37.11  Theorem. 

e  =  lim(l  +  h)1^1  =  lim  ( 1  H — ^  . 
h— >0  n—too  \  n  J 

Proof 

We  only  need  to  verify  the  first  equality.  Since  L'(  1)  =  1  by 
Theorem  37.4(i),  and  since  L(l)  =  0,  we  have 

1  =  lim  — - — — — - —  =  lim  — L(1  +  h)  =  lint  L  (( 1  +  . 

o  h  h-+ o  h  o  V  / 

Since  E  is  continuous,  we  can  apply  Theorem  20.5  on  page  158  to 
the  function  f(h )  =  L((l  +  h)1^)  to  obtain 

lim  (1  +  h)1/h  =  lim  e(l  f(l  +  h)1/h))  =  E(  1)  =  e. 
h — >-0  h — >-0  V  V  /  J 


37.12  Trigonometric  Functions. 

Either  approach  37.2  or  37.3  can  be  modified  to  rigorously  develop 
the  trigonometric  functions.  They  can  also  be  developed  using  the 
exponential  functions  for  complex  values  since 


sin x  =  —  \e%x  —  e  “1,  etc.; 
2i 


see  [62,  Chap.  8].  A  development  of  the  trigonometric  functions 
analogous  to  approach  37.3  can  proceed  as  follows.  Since  we  believe 


px 

arcsinx  =  /  (1  —  t2)”1/2  dt, 

Jo 


we  can  define  A{x)  as  this  integral  and  obtain  sinx  from  this.  Then 
cosx  and  tanx  are  easy  to  obtain.  In  this  development,  the  number 
7 r  is  defined  to  be  2  Jq(1  —  t2)-1/2  dt.  □ 


§38.  *  Continuous  Nowhere-Differentiable  Functions  347 


In  the  exercises,  use  results  proved  in  Theorem  37.4  and 
subsequent  theorems  but  not  the  material  discussed  in  37.1  and  37.2. 

Exercises 

37.1  Prove  directly  that 


dt  for  y,zG(  0,  oo). 


37.2  Prove  (iii)  of  Theorem  37.6. 

37.3  Prove  Theorem  37.8. 

37.4  Consider  b  >  0,  b  ^  1.  Prove  logh  y  =  for  y  €  (0,  oo). 

37.5  Let  p  be  any  real  number  and  define  f(x)  =  xp  for  x  >  0.  Show  / 
is  differentiable  and  f'{x)  =  pxp_1\  compare  Exercise  29.15.  Hint : 
f{x)  =  E{pL(x)). 

37.6  Show  xpyp  =  ( xy)p  for  p  €  R.  and  positive  x,  y. 

37.7  (a)  Show  that  if  B(x)  =  bx,  then  B'(x)  =  (logeb)bx. 

(b)  Find  the  derivative  of  logb. 

37.8  For  x  >  0,  let  f(x)  =  xx.  Show  f'{x)  =  [1  +  loge  x]  ■  xx. 

37.9  (a)  Show  log ey  <  y  for  y  >  1. 

(b)  Show 

<  -7=  for  y  >  1.  Hint:  loge  y  =  2  loge  y/y. 

y  Vv 

(c)  Use  part  (b)  to  prove  Hindoo  4  loge  y  =  0.  This  neat  little 
exercise  is  based  on  the  paper  [28]. 

§38  *  Continuous  Nowhere-Differentiable 

Functions 

The  history  of  continuous  nowhere-differentiable  functions  is  long 
and  fascinating.  Examples  of  such  functions  were  constructed  as  early 
as  1831,  by  Bernard  Bolzano.  But  a  version  wasn’t  published  until 
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Karl  Weierstrass  did  so  in  1875  [69];  he  had  given  examples  in  lec¬ 
tures  before  that  and  formally  presented  his  result  on  July  18,  1872. 
These  early  examples  tended  to  be  of  the  form  bn  cos(an7rx) 

or  E“=i  •  The  delay  in  publicizing  these  examples  is  due 

to  the  suspicion  of  mathematicians  of  the  era  that  the  definition  of 
“function”  should  not  be  so  general  as  to  allow  such  monstrosities. 

Excellent  brief  accounts  are  described  in  William  Dunham’s 
book  [21,  Chap.  9]  and  David  Bressoud’s  book  [13,  §6.4],  Dun¬ 
ham  asserts  that  Hermite,  Poincare  and  Picard  were  appalled  by 
Weierstrass’s  “pathological  example.”  Bressoud  has  a  quotation  from 
Henri  Poincare  that  refers  to  these  abnormal  functions  as  coun¬ 
terexamples  to  the  “flaws  in  our  forefathers’  reasoning. . .  ” .  There 
is  also  a  quote  of  Hermite  referring  to  the  “plague  of  functions  that 
do  not  have  derivatives”.  He  had  no  idea  how  bad  a  plague;  see 
Theorem  38.3  on  page  350  and  the  paragraph  preceding  it. 

An  especially  thorough  and  detailed  history  can  be  found  in 
Johan  Thirn’s  Master’s  thesis  [66]. 

Karl  Stromberg  [65,  Example  (4.8),  page  174]  provides  an  elegant 
variant  of  van  der  Waerden’s  example  [68],  published  in  1930.  We 
repeat  Stromberg’s  example  almost  verbatim  because  we  don’t  see 
how  to  improve  it. 


38.1  Van  der  Waerden’s  Example. 

We  provide  an  example  of  a  continuous  function  on  M  that  is  nowhere 
differentiable.  Let  4>(x)  =  |x|  for  |x|  <  2  and  extend  it  to  be  4- 
periodic,  i.e. ,  (j){x  +  4 q)  =  cj)(x)  for  all  x  £  M  and  q  €E  Z.  Since  the 
graph  of  4>  has  slope  ±1  on  intervals  between  even  integers,  we  have 

I0(«)  =  \s~t\  (1) 

provided  there  is  no  even  integer  in  the  open  interval  (s,t).  The 
graph  of  (j)  is  similar  to  that  of  g  in  Fig.  25.1  on  page  204;  in  fact, 
4>(x)  =  2g(|)  for  all  x. 

The  continuous  nowhere-differentiable  function  /  is  defined  by 

OO 

f{x)  =  ^  fn(x )  where  fn(x)  =  4_n3(4nx). 

71=1 
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Since  each  fn  is  continuous  and  4 ~n  ■  2  <  oo,  the  Weierstrass 

M-test  25.7  on  page  205  and  Theorem  25.5  show  /  is  continuous 
on  M. 

Fix  a  in  M;  we  will  show  /  is  not  differentiable  at  a  by  showing 
there  is  a  sequence  ( hk )  of  nonzero  numbers  satisfying 

hk  — >  0  and  lim  — — — — ^ does  not  exist.  (2) 
k — yoo  hk 

Until  Eq.  (5),  the  integer  k  >  1  is  fixed.  There  exists  ek  =  ±1  so  that 
no  even  integers  lie  between  4 ka  and  4 ka  +  ek.  Front  (1),  we  have 

1^(4 ka  +  ek)  -  (j){Ak a)\  =  1. 

In  fact,  for  n  <  k,  there  are  no  even  integers  between  4na  and 
4na  +  4™~kek,  because  if  4na  <2  q  <  4  na  +  An~kek  for  some  Z, 
multiplying  through  by  the  integer  4fe_n  would  yield  4fea  <  4fc_”-2 q  < 
4 ka  +  efc.  Thus,  by  (1)  again, 

|<£(4 na  +  4n-fcefc)  -  0(4na)|  =  An~k  for  1  <  n  <  k.  (3) 
Since  cj>  is  4-periodic,  we  also  have 

|0(4na  +  An~kek)  —  </>(4na)|  =  0  for  n  >  k.  (4) 

Combining  (3)  and  (4)  with  the  definition  of  fn,  we  conclude 
|  fn{a  +  4 ~kek)  —  fn{o) |  =  4_fe  for  n  <  k  and  =  0  for  n  >  k. 
We  now  let  hk  =  ^~kek  so  that 

|  fn{a  +  hk)  —  fn(a) |  =  4 ~k  for  n  <  k  and  =  0  for  n  >  k. 
Therefore  the  difference  quotient, 

f(a  +  hk)  -  f(a)  =  fn(a  +  hk)  -  fn(a) 
hk  ^  hk 

=  E  =  ^(±1),  (5) 

n=l  n=l 

is  an  even  integer  for  even  k  and  an  odd  integer  for  odd  k.  Therefore 
the  difference  quotients  in  (5)  cannot  converge,  as  k  — >  oo.  Since 
lirn /,.  hk  =  0,  this  proves  (2)  so  that  /  is  not  differentiable  at  a.  □ 
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38.2  Remark. 

For  later  use,  note  the  function  cf  in  the  preceding  proof  satisfies 
sup{ |0(2/)  |  :  y  6  M}  =  2,  and  for  any  y  in  M  we  have 

| <j)(y  +  h)  —  4>(y)\  =  h  for  sufficiently  small  h>  0.  (1) 

We’ve  seen  that  constructing  continuous  nowhere-differentiable 
functions  can  be  a  challenge.  Now  we  take  a  more  abstract  approach. 
In  the  discussion  after  Definition  22.6  on  page  183,  it  is  observed  that 
the  space  C (M)  of  bounded  continuous  functions  on  R  is  a  complete 
metric  space  using  the  metric 

d(f,g)  =  sup{|/(y)  -  g(y) \  :  y  E  M}  for  all  f,g  G  C'(M). 

Recall  from  Example  7(b)  on  page  174  that  the  irrational  numbers 
are  much  more  prevalent  than  the  rational  numbers,  because  the  set 
Q  is  of  first  category  in  the  complete  metric  space  M.  Similarly,  as  we 
will  see  in  the  next  theorem,  the  continuous  nowhere-differentiable 
functions  are  more  prevalent  than  the  differentiable  ones.  One  might 
say  mathematicians  of  the  19th  century  viewed  the  continuous 
nowhere-differentiable  functions  as  the  “irrational  functions.” 

As  just  noted,  the  next  theorem  shows  “most”  functions  in  C'(M) 
are  nowhere  differentiable.  The  proof  uses  the  Baire  Category  Theo¬ 
rem  21.8  in  the  enrichment  Sect.  21;  see  page  173.  In  1931,  S.  Banach 
and  S.  Mazur kiewicz  independently  published  this  result  in  Studia 
Mathematica. 


38.3  Theorem. 

Let  V  consist  of  the  functions  f  in  C(M)  that  have  a  derivative  at  at 
least  one  point.  Then  T>  is  first  category  in  C  (M) . 


Proof 

Consider  /  in  T>.  Then  for  some  x  in  K,  the  derivative  f'(x )  exists. 
Choose  m  so  that  \x\  <  m  and  \  f'(x)\  <  m.  There  exists  5  in  (0, 1) 
so  that 


f(x  +  h)  —  f{x)  , 


h 


<  m  —  \f'(x)\  for  all  h  €  (0,  <5). 
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Select  a  positive  integer  n>  m  satisfying  -  <  5.  Then 

ig[- n,n]  and  \f(x  +  h)  —  f{x)\<hn  for  he  ^0,  —  j  .  (1) 

Thus  /  belongs  to  Tn ,  which  is  defined  to  be  all  /  in  C(M)  such  that 
some  x  in  R  satisfies  (1)  above.  We  have  just  shown  V  C  U^L1  Tn,  so 
by  the  Baire  Category  Theorem  21.8  on  page  173,  it  suffices  to  show 
each  J-n  is  closed  in  C(M)  and  is  nowhere  dense  in  C(R). 

To  see  Tn  is  closed,  consider  a  sequence  (fk)  in  Tn  converging 
to  /  in  C(M).  As  noted  after  Definition  22.6,  this  means  fk  — >  / 
uniformly  on  M.  We  will  show  /  is  in  Tn.  For  each  k ,  there  exists  x k 
so  that 

xk  G  [- n,n ]  and  \fk(xk  +  h)~  fk(xk)\  <  hn  for  h  G  ^0,  ^  .  (2) 

By  the  Bolzano- Weierstrass  Theorem  11.5,  a  subsequence  of  ( xk ) 
converges  to  some  x  in  [— n,n];  to  avoid  subsequence  notation,  we 
will  assume  the  sequence  (xk)  itself  converges  to  x.  Since  xk  — >  x  and 
fk  — >  f  uniformly,  we  have  fk{xk  +  h )  f(x  +  h )  for  each  h  G  [0,  ^); 
see  Exercise  24.17  on  page  200.  For  each  h  in  (0,  ^),  we  take  the  limit 
in  (2)  as  k  — >  oo  to  obtain  (1).  Hence  /  belongs  to  Fn,  and  Tn  is 
closed. 

To  show  Tn  is  nowhere  dense,  it  suffices  to  show  no  ball  Br(g )  = 
{/  G  C(M)  :  d(f,g)  <  r}  is  a  subset  of  any  Tn,  i.e.,  every  such  ball 
contains  a  function  in  C(M)\  Fn.  By  the  corollary  to  the  Weierstrass 
Approximation  Theorem  27.5  on  page  220,  there  is  a  polynomial  p 
such  that  sup{| g{y)  -  p(y)\  :  y  G  [-n  -  1,  n  +  1]}  <  §,  p{-n  -  1)  = 
g(— n  —  1)  and  p(n  +  1)  =  g(n  +  1).  The  function  p  on  M,  dehned  by 
p(y )  =  p(y)  for  \y\  <  n  +  1  and  p(y)  =  g(y)  for  |y|  >  n  + 1,  is  in  C(M) 
and  satisfies  d(g,p )  <  |.  We  choose  K  >  n  so  that  it  also  satisfies 
K  >  sup{|p'(y)|  :  y  G  [— n  —  1  ,n  +  1]}.  Then  for  each  x  in  [— n,n\, 
the  Mean  Value  Theorem  29.3  on  page  233  implies 

| p(x  +  h)  —  p(x)  |  <  hK  for  sufficiently  small  h  >  0.  (3) 

A  modification  of  the  sawtooth  function  f  in  van  der  Waerden’s 
Example  38.1  on  page  348  satisfies 


sup{|V’(2/)|  :  y  G  K}  <  - 


(4) 
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and 


\ip{x  +  h)  —  ip{x)  |  >  2 Kh  for  sufficiently  small  h  >  0,  (5) 

for  all  x  in  K.  In  fact,  using  Remark  38.2,  it  is  easy  to  check  ip(y)  = 
|0(12fy)  works.  Since  d(p,g )  <  §,  inequality  (4)  shows  p+V’  belongs 
to  Br(g).  From  (5)  and  (3),  we  see 

| (p  +  ip)(x  +  h)  —  (p  +  ip)(x)\  >  hK  >  hn 

for  each  x  E  [— n,  n]  and  sufficiently  small  h  >  0,  which  shows  p  +  ip 
cannot  be  in  Fn.  ■ 


In  Theorem  38.5  below,  we  give  another  interesting  application 
of  the  Baire  Category  Theorem  21.8.  It  is  due  to  Corominas  and 
Sunyer  Balaguer  [17,  1954],  See  also  Boas  [9,  Chap.  1,  §10],  Phillips 
[52,  Chap.  4,  §3,  Theorem  18],  and  Donoghue  [20,  §1.11].  Interesting 
generalizations  can  be  found  in  [17]  and  Kriippel  [38].  There  are 
relatively  straightforward  versions  for  holomorphic  complex-valued 
functions;  see,  e.g.,  Burckel  [14,  Example  5.64], 

First,  we  give  an  easy  result.  Henceforth,  when  we  refer  to  an 
open  interval  (a,/3),  we  allow  a  =  —  oo  and  /3  =  oo,  so  that  in 
particular  (a, /3)  may  be  K.  As  in  Sect.  31,  we  write  / for  the  nth 
derivative  of  /. 

38.4  Proposition. 

Let  f  be  a  function  on  an  open  interval  and  suppose  there  is 

an  integer  n  such  that  f(n\x)  =  0  for  all  x.  Then  f  agrees  with  a 
polynomial  on  (a,  ft)  of  degree  at  most  n  —  1. 

Proof 

This  can  be  seen  by  integrating  the  function  /(n)  n  times.  At 
each  step,  one  obtains  a  polynomial  of  one  higher  degree;  see 
Corollary  29.5  and  Exercise  29.7.  ■ 


We  write  C°°((a,  /3))  for  the  space  of  functions  /  infinitely  differ¬ 
entiable  on  (a,  (3),  i.e.,  all  the  derivatives  / ^  exist  on  ( a, /3 ).  Here 
we  agree  /^0)  =  /. 
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38.5  Theorem. 

Suppose  f  is  in  C°°((a,  (3)),  and  suppose  for  each  x  in  (a,  (5),  there 
is  an  integer  nx  ( depending  on  x)  such  that  f(nx\x)  =  0.  Then  f  is 
a  polynomial  on  ( a.,/3 ). 

We  begin  with  a  lemma. 

38.6  Lemma. 

Suppose  xq  is  in  M,  p  and  q  are  polynomials,  and  f  is  a  C°°  function 
defined  on  an  interval  containing  xq  that  agrees  with  p  on  an  interval 
(xo  —  h,  xo]  and  agrees  with  q  on  an  interval  [xo,  xo  +  h).  Then  p  =  q. 

Proof 

Assume  p  ^  q,  and  let  rn  be  the  degree  of  the  polynomial  p  —  q. 
Then  (p  —  q)^m\x o)  7^  0,  contradicting  p(m\x 0)  =  f<ym\x 0)  = 
q{m\x  0).  ■ 


Proof  of  Theorem  38.5 

It  suffices  to  show  that  /  agrees  with  a  polynomial  on  every  closed 
subinterval  [c,d\  of  (a,  (3).  To  see  this  is  sufficient,  consider  a  de¬ 
creasing  sequence  (cn)  with  limit  a  and  an  increasing  sequence  ( dn ) 
with  limit  f3,  where  c\  <  d\.  For  each  n,  let  pn  be  a  polynomial  that 
agrees  with  /  on  [cn,dn].  Then  each  pn  agrees  with  p\  on  [ci,di]. 
Hence  pn  =  p\  for  all  n.1  It  follows  that  /  =  p\  on  ( a ,  /3). 

Step  1.  In  this  step,  we  show  that  every  nondegenerate  closed 
subinterval2  I  of  [c,  d]  contains  an  open  subinterval  J  on  which  /  is  a 
polynomial.  For  each  k  >  0,  we  let  =  {x  G  I  :  f^k\x)  =  0}.  Then, 
by  hypothesis  I  =  Ufc>o  and  by  the  continuity  of  the  function  / 
and  all  of  its  derivatives,  each  E ^  is  closed.  By  the  Baire  Category 
Theorem  21.8  on  page  173,  for  some  index  n,  En  has  nonempty 
interior.  Thus,  for  such  an  index,  there  is  an  open  subinterval  J  C  En 
of  I  such  that  f^n\x)  =  0  for  all  x  G  J.  By  Proposition  38.4,  /  agrees 
with  a  polynomial  on  J,  as  claimed. 


1  Polynomials  that  agree  on  an  infinite  set  are  equal;  otherwise  their  difference 
would  be  a  nonzero  polynomial  with  infinitely  many  zeros. 

2 Nondegenerate  here  means  that  its  endpoints  are  not  equal. 
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Step  2.  In  this  step,  we  identify  maximal  nondegenerate  closed 
subintervals  of  [c,  d\  on  which  the  restriction  of  /  is  a  polynomial.  For 
any  polynomial  p  that  agrees  with  /  on  an  open  interval  containing 
a  point  xo  in  [c,  d],  let 

ap(x o)  =  inf{x  <E  [c,  x0\  :  f  =  p  on  [x,  x0]} 

and 

bp(x0)  =  sup{x  <E  [x0,  d\  :  /  =  p  on  [x0,  x]}. 

Let  Ip(x o)  =  [ap(xo),  6p(xo)],  and  note  ap(x o)  <  bp(x o)  and  /p(x o)  C 
[c,d\.  Then 

(a)  Ip(x o)  is  the  maximal  closed  subinterval  of  [c,  d]  containing  xo 
on  which  /  agrees  with  p; 

(b)  (op(xo),  bp(xo))  is  the  maximal  open  subinterval  of  [c,d] 
containing  xo  on  which  /  agrees  with  p; 

(c)  The  closed  intervals  /p(x o)  are  either  disjoint  or  identical. 

To  check  assertion  (c),  assume  Ipo(xo)  C/Pl  (xi)  ^  0,  where  xo  <  xi. 
Clearly  api  (xi)  <  bpo(x o).  If  bp 0(xo)  =  api  (xi),  then  /  agrees  with  po 
to  the  left  of  this  value,  and  /  agrees  with  p\  to  the  right  of  this  value. 
But  then  Lemma  38.6  shows  po  =  Pi,  so  the  closed  intervals  involved 
aren’t  maximal.  Therefore  aPl  (xi)  <  bPo  (xo),  and  the  polynomials  pi 
and  po  agree  on  the  open  interval  (api(xi),  bpo(x o)).  Hence  po  =  pi- 
Now  /  agrees  with  po  =  pi  on  the  closed  interval  [apo(xo),  6pi(xi)], 
so  by  maximality, 

[aPo(x0),bPl(x1)\  =  [aPo(xo),6p0(x0)]  =  [aPl  (xi),  bPl  (xi)]. 

Therefore  /po(x0)  =  [apo(x0),bpo(x0)}  =  [api  (xi),  bpi  (xi)]  =  Ipi(x i), 
and  (c)  holds. 

Step  3.  Our  goal  is  to  show  all  the  closed  intervals  in  Step  2  are  the 
same,  i.e. ,  all  equal  [c,  d],  which  would  prove  the  theorem.  Assume,  on 
the  contrary,  that  there  exist  xi,  X2  in  [c,  d]  and  polynomials  pi,P2  so 
that  Jpi(x i)  7^  IP2{x 2).  We  assume  x\  <  X2 .  Then  6pi(xi)  <  aP2(x 2) 
and  we  will  focus  on  [6pi(xi),  aP2(x2)],  which  we  will  write  as  [b,  a], 
so 

/P1(xi)  ^  IP2(x2)  and  [b,  a]  =  [6pi(xi),  aP2(x2)].  (1) 

Consider  the  nondegenerate  closed  intervals  from  Step  2  that  are 
subintervals  of  ( b ,  a).  Since  these  intervals  are  disjoint,  there  are  only 
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countably  many  of  them.  Moreover,  there  cannot  be  finitely  many  of 
them,  because  if  there  were,  there  would  be  an  open  interval  in  (6,  a) 
that  is  disjoint  from  the  finite  union  of  them.  By  Step  1,  there  would 
be  another  closed  interval  as  described  in  Step  2,  a  contradiction. 

We  relabel  the  countably  infinite  disjoint  family  of  maximal  open 
intervals  in  Step  2,  that  are  subsets  of  (b,  a),  by  ( ak,bk )•  Observe 
{ _)k(dk,bk )  is  dense  in  [b,  a];  otherwise  there  is  a  nonempty  open  in¬ 
terval  in  [b,  a]  \  Ufc(afc)  and  by  applying  Step  1  we  could  expand 
our  family.  Let  K  =  [b,  a]  \  Ufc(afc>  which  is  clearly  closed.  Let  E 
be  the  set  of  endpoints  of  the  intervals  [b,  a]  and  all  (a*,,  &&).  Observe 
that  E  C  K.  Note  that,  by  (1),  b  and  a  are  right  and  left  endpoints, 
respectively,  of  maximal  open  intervals. 

Step  4.  In  this  step,  we  show  that  K  is  a  perfect  set,  as  defined 
in  Discussion  21.10  on  page  174,  i.e.,  every  point  x  in  K  is  the  limit 
of  a  sequence  of  points  in  K  \  {x}.  Otherwise,  for  some  x  in  K  and 
h  >  0  we  have  K  n  (x  —  h,  x  +  h)  =  {x}.  The  point  x  cannot  be 

both  a  left  and  a  right  endpoint  in  E,  so  we  may  assume,  say,  that 

x  is  not  a  left  endpoint  in  E.  Then  x  ^  a  and  we  may  suppose  that 
(x,x  +  h)  C  (6,  a).  Since  (x,x  +  h)  intersects  the  dense  set  IJ k[ak,bk], 
we  have  (x,  x  +  h)  fl  [a*,,  &&]  ^  0  for  some  k.  Then  <  x  +  h  and 
x  <  6^.  Since  x  ^  a^,  x  is  not  in  {a^}  U  (ak,bk)  =  [a*,,^).  Since 

x  <  bki  we  have  x  <  <  x  +  h  and  belongs  to  (x,  x  +  h).  Thus 

ak  GE  K  fl  (x,x  +  h ),  a  contradiction.  Thus  K  is  perfect. 

Step  5.  In  this  step,  we  obtain  a  contradiction  to  our  hypotheses 
by  showing  there  is  xq  6  K  satisfying  f^n\x o)  ^  0  for  all  n  >  0. 
This  will  prove  the  theorem. 

Claim  1.  Let  J  be  an  open  interval  in  [b,  a]  satisfying  JflTv  ^  0, 
and  consider  an  integer  n  >  0.  Then  exists  an  x  6  J  (~l  K  such  that 
/H(x)  ^  o. 

Assume  that  J  is  as  specified,  but  that  no  satisfies  f^n°\x)  =  0 
for  all  x  £  J  fl  K.  We  show  by  induction 

f^n\x)  =  0  for  n  >  no  and  all  x  E  J  fl  K.  (2) 

Suppose  (2)  holds  for  some  n  >  no,  and  consider  x  E  JCK.  Since  K 
is  perfect,  there  is  a  sequence  (xk)  in  K  \  {x}  such  that  lim^  Xk  =  x. 
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Since  J  is  open,  we  may  suppose  that  all  xk  are  also  in  J.  Hence 


f(n+1\x)  =  lim 
k — ^oo 


&\xk)-  /(»>(s) 

Xk-  X 


0-0 

Inn  -  =  0; 

k— too  xk  —  x 


i.e.,  (2)  holds  for  n  +  1.  By  induction,  we  conclude  that  (2)  holds  as 
stated. 

On  the  other  hand,  if  x  £  J  \  K  then  x  belongs  to  one  of  the 
maximal  open  intervals  ( ak,bk ).  Since  J  HK  7^  0,  there  exists  y  in 
J  \  ( ak,bk ),  so  that  y  <  ak  or  y  >  bk,  say  y  >  bk.  Since  x  <  bk 
and  J  is  an  interval,  J  also  contains  bk.  Thus  bk  belongs  to  J  n  K. 
Let  pk  be  the  polynomial  that  agrees  with  /  on  (ak,bk)-  Since  x 
is  in  ( ak,bk ),  we  have  f^\x)  =  p^\x)  for  all  j  >  0.  If  pk  is  the 
zero  polynomial,  then  clearly  f(n°\x)  =  p^°\x)  =  0.  Otherwise,  let 
rik  be  the  degree  of  the  polynomial  pkl  so  that  p(nk>  is  the  nonzero 
constant  function  p^nk\bk)-  Since  bk  is  in  J  n  K,  (2)  implies  that 
nk  <  no  and  f(n°\x)  =  p(n°\x)  =  0.  Summarizing,  f(n°\x)  =  0  for 
all  x  in  the  open  interval  J,  so  /  agrees  with  a  polynomial  on  J  by 
Proposition  38.4  and  J  C  bk),  contradicting  J C\K  ^  0.  This 

proves  Claim  1. 

Since  each  is  continuous,  Claim  1  implies: 


Claim  2.  If  n  >  0  and  J  is  an  open  interval  in  [ b ,  a]  satisfying 
JnK  ^  0,  then  there  is  an  open  interval  J'  so  that  J'  C  J ,  J' nK  7^ 
0  and  f^(x)  ^  0  for  all  x  £  J'  fl  K.3 

Applying  Claim  2  to  J  =  (6,  a),  we  obtain  an  open  interval  Jo  so 
that  Jo  n  K  0  and  f(x)  7^  0  for  x  £  Jo  (~l  K.  Repeated  use  of  the 
claim  yields  a  sequence  ( Jn)  of  open  intervals  so  that 

Jo  2  Ti  D  Ji  D  T2  D  J2  2  ■  ■  ■ ,  (3) 

each  JnHK  7^  0  and  f(n\x)  7^  0  for  all  x  £  Jn0K.  Since  P|n  JnC\K  = 
Dn  JnCK  7^  0,  by  Theorem  13.10  there  is  xo  in  K  that  belongs  to  all 
the  intervals  Jn.  Therefore  f^n\x 0)  7^  0  for  all  n  >  0;  this  completes 
Step  5  and  the  proof  of  the  theorem.  ■ 


3  The  notation  J'  represents  the  closure  of  the  interval  J' . 
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38.7  Corollary. 

Suppose  — oo  <  a  <  (3  <  oo.  If  f  is  continuous  on  [cq/3],  and  if  f 
satisfies  the  hypotheses  of  Theorem  38.5  on  (a,  (3),  then  f  agrees  with 
a  polynomial  on  [a,  f3\. 

Even  though  continuous  nowhere-differentiable  functions  are 
plentiful,  by  Theorem  38.3,  the  next  theorem  shows  every  continuous 
function  on  M  is  arbitrarily  close  to  nice  functions. 

38.8  Theorem. 

Given  a  continuous  function  f  on  M  ( bounded  or  not )  and  e  >  0, 
there  is  a  piecewise  linear  function 4  g  and  a  function  in  C00^) 
such  that  sup{|/(x)  —  g(x)\  :  x  G  M}  <  e  and  sup{|/(x)  —  fi{x)\  :  x  G 
M}  <  e. 

Proof 

If  you  look  at  pictures  of  a  couple  of  continuous  functions  /,  as  well 
as  f  +  e  and  /  — e,  as  in  Fig.  24.1  on  page  195,  you  might  conclude  the 
existence  of  such  a  piecewise  linear  function  is  obvious.  The  only  flaw 
in  this  thinking  is  that,  as  we  know,  general  continuous  functions  can 
be  quite  complicated,  and  impossible  to  graph.  For  this  reason,  we 
include  a  proof. 

Step  1.  If  /  is  continuous  on  [a,  b]  and  e  >  0,  then  there  is  a 
piecewise  linear  function  g  on  [a,  b]  satisfying  sup{|/(x)  —  g{x)\  :  x  G 
[a,  &]}  <  e.  To  see  this,  we  use  uniform  continuity  of  /  to  obtain  5  >  0 
so  that 

|s  —  t|  <  5,  s,t€[a,b\  implies  |/(s)  -  f(t)\  <  |. 

Select  a  partition  {a  =  to  <  t\  <  ■  ■  ■  <  tn  =  6}  of  [a,b]  with 
mesh  <  S.  For  each  k  =  l,2,...,n,  let  Ik  be  the  linear  function 
satisfying  4(4-i)  =  /(4-i)  and  4(4)  =  /(4)-  We  write  mk  for 
min{/(4-i),  /(4)}  and  Mk  for  max{/(4_i),  /(4)}.  Then  for  x  in 
[4_i,4],  we  have 

mk-  '-<  f(x)  <  Mk+(-  and  Mk  -  mk  <  -. 


4 A  piecewise  linear  function  on  an  interval  is  a  continuous  function  that  is  linear 
on  subintervals. 
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Thus  f(x)  lies  between  —  |  and  rrik  +  y.  The  same  is  true  for 
(k(x),  and  therefore 

\f(x)-(k(x)\<e  for  xe[tk-i,tk\. 

The  function  g  on  [a,  b],  defined  by  g(x)  =  (k(x)  for  x  in  [tfc _ 1 ,  tfc] , 

satisfies  sup{|/(x)  —  g(x)\  :  x  G  [a,  b]}  <  e. 

Step  2.  Let  £  be  a  linear  function  on  an  interval  [a,  b\.  There  is 
a  monotonic  function  i/j  in  C'°°(M)  so  that  ip(a)  =  ((a),  ip(b)  =  ((b), 
all  derivatives  of  ^  at  a  and  b  are  0,  and 

| ij)(x)  —  ((x)\  <  | ((b)  —  ((a) |  for  all  x  €  [ a,b\ .  (1) 

We  begin  with  the  function  h  =  h*a  b  in  Exercise  31.4  on  page  267. 
Then  h{x)  =  0  for  x  <  a,  h(x)  =  1  for  x  >  b,  h  is  increasing  on  [a,  b ], 
and  all  its  derivative  are  0  at  a  and  at  b.  In  fact, 

h(x)  =  _ _ 

{)  f(X-a)  +  f(b-x) 

where  /  is  the  function  in  Example  3  and  Fig.  31.1  on  page  257.  From 
the  quotient  rule,  and  writing  D  for  the  denominator  obtained  using 
the  quotient  rule,  we  see 

h'(x)  =  [f(b  -  x)f'(x  -  a)  +  f(x  -  a)f'(b  -  x)\/D(x). 

This  is  nonnegative,  so  h  is  increasing.  By  looking  at  the  right- 
hand  derivatives  of  h  at  a,  and  the  left-hand  derivatives  at  6,  we 
see  h(n\a)  =  h^n\b)  =  0  for  all  n  in  N.5  Let 

ip(x)  =  ((a)  +  [((b)  —  ((a)}  ■  h(x)  for  x  €  [a,  b\. 

Condition  (1)  holds  because,  for  x  in  [a,b],  both  tp(x)  and  t(x)  lie 
between  ((a)  and  ((b). 

Step  3.  Given  a  piecewise  linear  function  g  on  [a,  b]  and  e  >  0, 
there  is  a  function  ^  in  C°°(M)  so  that  ip(a)  =  g(a),  ip(b)  =  g(b),  all 
derivatives  of  ^  at  a  and  b  are  0,  and 

sup{|^(a;)  -  g(x) |  :  x  €  [a,  6]}  <  e.  (2) 


5  Regarding  why  h,  the  quotient  of  two  infinitely  differentiable  functions,  also  is 
infinitely  differentiable,  see  Exercise  38.6. 
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As  in  Step  1,  there  is  a  partition  {a  =  to  <9  <  ■  ■  ■  <  4  =  b}  of 
[a,b]  such  that  \g(tk)  —  g(tk- 1)|  <  e  and  such  that  g  agrees  on  each 
[4-i,4]  with  a  linear  function  t =  1,2, ...  ,n.  Apply  Step  2  to 
each  [4-i,4]  to  obtain  a  function  fik  in  CIOO(M)  so  that  ipk(tk- 1)  = 
4(4- 1)  =  <7(4- l)  and  similarly  4fc(4)  =  <7(4),  all  derivatives  at 
4-i  and  4  are  0,  and 

\ipk(x)  ~  g{x) |  <  |4(4)  -  4(4-i)|  <  e  for  all  x  6  [4-1,4]- 

The  desired  if  is  defined  by  ip(x)  =  ipk(x)  for  x  6  [4-i,4],  &  = 

1,  2, • • • , n. 

S'tep  4.  Consider  a  continuous  function  /  on  M  and  e  >  0.  By 
Step  1,  for  each  k  in  Z,  there  is  a  piecewise  linear  function  gk  on  the 
interval  [A;,  k  +  1]  satisfying 

sup{|3fc(z)  -  f(x) |  :  x  €  [fc,  k  +  1]}  <  (3) 

We  apply  Step  3  to  each  interval  [k,  k  +  1]  to  obtain  i[>k  in  C'°°(M)  so 
that  =  f{k),  ipk(k  +  1)  =  f(k  +  1),  all  derivatives  of  V’fc  are  0 

at  k  and  k  +  1,  and 

sup{|t44)  -  gk(x) |  :  x  <E[k,k  +  1]}  <  |.  (4) 

We  obtain  i/j  in  by  defining  ^(x)  =  tpk(x)  for  x  in  [k,  k  +  1], 

k  €  Z.  From  (3)  and  (4)  we  conclude 

sup{|^(x)  -  f(x)  | 

O  ■ 


38.9  Corollary. 

T/ie  space  of  all  bounded  piecewise  linear  functions  and  the  space 
C°°(M)nC(M)  of  all  bounded  infinitely  differentiable  functions  on  M 
are  dense  in  C(M),  using  the  distance  d(f,g)  =  sup{|/(y)  —  g(y)\  : 
j/SR}  defined  prior  to  Theorem  38.3. 

The  next  result  is  both  a  corollary  to  Theorem  38.8  and  a  lemma 
for  the  next  result. 

38.10  Lemma. 

Consider  continuous  f  on  [a,b],  e  >  0,  and  a  constant  c  >  0. 
Then  there  is  a  piecewise  linear  function  g  on  [a,  b]  such  that 
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sup{|/(x)  —  g(x)  |  :  x  G  [a,  6]}  <  e  and  the  absolute  value  of  the 
slope  of  each  of  its  linear  segments  exceeds  c. 

Proof 

Before  continuing,  you  might  wish  to  reread  the  first  paragraph  of 
the  proof  of  Theorem  38.8.  Since,  by  that  theorem,  it  now  suffices  to 
consider  the  case  when  /  itself  is  a  linear  function  £,  it  will  be  easy 
to  see  why  this  lemma  is  true. 

It  suffices  to  consider  the  case  when  l  is  increasing,  and  we  may 
assume  c  exceeds  the  slope  of  i.  There  is  a  8  >  0  sufficiently  small 
that  one  can  replace  any  line  segment  from  (x,  £(x))  to  (x+8,  £(x+5)) 
by  two  line  segments,  one  rising  from  (x,£(x)),  with  slope  exceeding 
c,  to  the  line  £  + |,  and  the  other  dropping  down  to  (x  +  8,  f(x  +  8)), 
at  a  slope  less  than  —  c.  By  replacing  <5  by  a  smaller  8,  if  necessary, 
we  may  assume  8  divides  b  —  a.  Then  there  is  partition  {to  =  a  < 
ti  <  •  ■  ■  <  tn  =  b}  of  [a,  b\,  with  tk  =  tk- i  +  <5  for  each  k,  so  that  each 
line  segment  from  (tk-i,£(tk~i))  to  (■ tk,£(tk ))  can  be  replaced  by 
two  line  segments  each  with  slope  exceeding  c  in  absolute  value.  The 
resulting  piecewise  linear  function6  g  on  [a,  6]  is  continuous  because 
it  agrees  with  f  =  £  at  each  tk,  and  it  satisfies 

sup{|5(x)  -  /(x)|  :  x  G  [a,b]}  =  |  <  e. 

This  establishes  the  lemma.  ■ 

We  now  return  to  continuous  nowhere-differentiable  functions. 
So  far  as  we  know,  until  1992  the  construction  of  such  functions 
has  involved  summing  certain  continuous  functions,  i.e. ,  building 
them  up  from  simpler  functions.  The  next  construction,  due  to  Mark 
Lynch  [44]  in  1992,  is  quite  different,  using  some  topology  and  no  infi¬ 
nite  series.  Lynch  starts  with  certain  subsets  of  the  plane  and  shrinks 
them  down  to  the  graph  of  a  continuous  nowhere-differentiable  func¬ 
tion.  He  uses  Example  6  on  page  171,  which  states  that  a  function 
on  a  compact  subset  of  M  is  continuous  if  and  only  if  its  graph  is 
compact.  Later  Lynch  [45]  generalized  his  technique  to  construct 
continuous  functions  that  are  differentiable  only  at  the  rationals. 


6It  is  tempting  to  call  this  a  “stegosaurus  linear  function.” 
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Below,  we  simplify  the  technique  in  [45]  just  to  obtain  a  continuous 
nowhere-differentiable  function. 


38.11  Mark  Lynch’s  Construction. 

Step  1.  Let  £  be  a  linear  function  on  an  interval  [a,  b\.  Then  its  graph 
L  is  a  line  segment  in  the  plane.  We  assume  the  slope  of  l  exceeds  2n 
in  absolute  value.  We  will  construct  a  (closed)  rhomboid'  R  about 
L  with  the  following  property: 


Property  Rn:  If  /  is  a  function  on  [a,b\  and  if  the  graph  of 

/  is  contained  in  R,  then  for  each  x  6  [a,  b]  there  is  y  6  [a,  b] 

such  that  x  ^  y  and  I  I  >  n ■ 

y  x 

First,  we  suppose  the  slope  exceeds  2 n.  Let  m  =  be  the  midpoint 

of  the  interval  [a,  b] .  Then  we  have 

£(b)  —  £(m)  £(m)  —  £(a) 


—  a 


b  —  a 


>  n\ 


thus  there  exists  e  >  0  so  that 
£(b)  —  e  —  [£(m)  +  e] 


>  n  and 


£(m)  —  e  —  [£{a)  +  e] 


>  n.  (1) 


b  —  a  b  —  a 

The  desired  rhomboid  R  is  bounded  above  and  below  by  the  graphs 
of  £  T  e  and  £  —  e,  and  bounded  on  the  left  and  right  by  the  vertical 
line  segments  connecting  (x,  £(x)  —  e)  and  (x,  £(x)  +  e)  for  x  =  a  and 
for  x  =  b.  Consider  x  in  [a,  b\.  If  x  <  m,  then  using  (1)  we  obtain 

f{b)  -  f{x)  £{b)  -  e  -  [£{x)  +  e]  £{b)  -  e  -  [l(ro)  +  e] 

b  —  x  ~  b  —  a  ~  b  —  a  ’ 

so  Property  Rn  holds  with  y  =  b.  If  x  >  rn.  then 


f{x)  -  /(a)  ^  £(x)  -  e  -  [£(a)  +  e]  ^  £{m)  -  e  -  [1(a)  +  e]  ^  m 


x  —  a  0  —  a 

and  Property  Rn  holds  with  y  =  a. 


b  —  a 


Now  suppose  the  slope  of  £  is  less  than  —2 n.  Then  use  —  £  to 
obtain  a  rhomboid  R'  satisfying  Property  Rn.  Let  R  =  —R'.  If  the 


7For  us,  a  rhomboid  is  a  parallelogram  with  unequal  adjacent  angles. 
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Solid  nonvertical  lines 
Line  JL  has  slope  >2.  have  slope  >  4  or  <-4 


FIGURE  38.1 


graph  of  /  is  contained  in  R,  then  the  graph  of  — /  is  contained  in 
R' ,  and  Property  Rn  holds  for  —  /  and  R' .  So  it  holds  for  /  and  R. 

Step  2.  Now  we  construct  a  continuous  nowhere-differentiable 
function  on  [0,1].  We  begin  with  a  piecewise  linear  function  g\  on 
[0, 1]  such  that  the  absolute  value  of  the  slope  of  each  segment  ex¬ 
ceeds  2.  Note  g\  can  be  selected  to  be  linear  on  [a,  b],  as  illustrated 
in  Fig.  38.1,  and  observe  the  x  and  y  axes  are  not  drawn  to  scale. 
Let  C\  be  the  union  of  rhomboids  surrounding  the  line  segments  of 
g i,  where  each  rhomboid  satisfies  Property  Rn  for  n  =  1.  Then  C\ 
satisfies  the  following  property  for  n  =  1. 


Property  n:  If  /  is  a  function  on  [0, 1]  and  if  the  graph  of  / 
is  contained  in  Cn,  then  for  each  x  6  [0, 1]  there  is  y  6  [0, 1] 
such  that  0  <  \y  —  x\  <  ^  and 


f{y)-f{x) 

y-x 


>  n. 


For  the  inductive  construction,  suppose  we  have  C\, . . .  ,Cn-\  sat¬ 
isfying  Cn- 1  C  ■  •  •  C  C\,  where  each  C k  is  a  union  of  rhomboids 
satisfying  Property  k.  By  Lemma  38.10,  there  is  a  piecewise  linear 
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function  gn  on  [0, 1]  whose  graph  lies  in  the  interior  of  Cn- ±  such 
that  the  absolute  value  of  the  slope  of  each  segment  exceeds  2 n.  By 
breaking  segments  of  gn  into  smaller  segments,  if  necessary,  we  may 
assume  their  domains,  i.e. ,  their  projections  onto  the  x-axis,  each 
have  length  <  - .  By  Step  1 ,  each  such  segment  of  gn  is  included  in 
a  rhomboid  satisfying  Property  Rn,  with  the  additional  conclusion 
0  <  \y  —  x\  <  Therefore  Cn  satisfies  Property  n.  Moreover,  since 
the  graph  of  gn  lies  in  the  interior  of  Cn- 1,  the  construction  in  Step  1 
shows  (using  a  smaller  e  if  necessary)  we  can  select  the  rhomboids 
so  that  their  union  Cn  is  a  subset  of  Cn- \  and  so  that  the  vertical 
line  segments  in  Cn  have  length  <  ^ . 

Now  let  C  =  r\™=lCn.  Each  set  Cn  is  a  closed  and  bounded 
set  in  the  plane,  hence  compact.  By  Theorem  13.10  on  page  89,  C 
is  compact  and  nonempty.  Also,  for  each  x  in  [0, 1],  the  sets  { y  £ 
[0, 1]  :  ( x ,  y)  £  Cn}  are  compact  and  nonempty  and,  since  the  vertical 
line  segments  in  Cn  have  length  <  — ,  their  intersection  {y  £  [0, 1]  : 
(x,  y)  £  C }  has  exactly  one  point.  Thus  C  is  the  graph  of  a  function  / 
on  [0, 1].  Since  its  graph  is  compact,  Example  6  on  page  171  shows  /  is 
continuous.  Finally,  consider  x  in  [0, 1].  For  each  n,  using  Property  n 

we  obtain  yn  in  [0, 1]  so  that  0  <  \yn  —  x|  <  ^  and  Z{^  >  n- 
Thus  /  is  not  differentiable  at  x.  □ 


Exercises 

38.1  Why  hasn’t  anyone  constructed  a  nowhere-differentiable  continuous 
function  by  simply  finding  a  suitably  complicated  Taylor  series? 

38.2  Show  that  if  /  is  a  function  on  R  and  / ^  is  a  polynomial  for  some  n, 
then  /  is  itself  a  polynomial. 

38.3  Show  that  there  is  a  differentiable  function  on  R  whose  derivative  is 
nowhere  differentiable. 

38.4  If  /  is  nowhere  differentiable  and  g  is  differentiable  on  R,  must  f  +  g 
be  nowhere  differentiable? 

38.5  Consider  continuous  nowhere-differentiable  functions  /  and  g  on  R. 
(a)  Must  /  +  g  be  nowhere  differentiable? 
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(b)  Show  fg  need  not  be  nowhere  differentiable.  Hint :  Let  /  be  a 
nowhere-differentiable  function  satisfying  d(f,  1*)  <  1,  where  1* 
denotes  the  constant  function  identically  equal  to  1  on  R.  Explain 
why  the  reciprocal  g  of  /  is  nowhere-differentiable  on  R. 

38.6  In  Exercise  31.4  it  was  noted,  without  proof,  that  the  sum,  product, 
etc.  of  infinitely  differentiable  functions  is  again  infinitely  differen¬ 
tiable.  Also,  f/g  is  infinitely  differentiable  if  both  /  and  g  are,  and  if 
g  never  vanishes.  Verify  the  last  claim.  Hint:  Show  the  nth  derivative 
of  f/g  has  the  form  hn/g2  where  hn  is  infinitely  differentiable. 


Appendix  on  Set  Notation 


Consider  a  set  S.  The  notation  means  x  is  an  element  of 

S ;  we  might  also  say  ux  belongs  to  S"  or  “x  is  in  S.”  The  notation 
x  £  S  signifies  x  is  some  element  but  x  does  not  belong  to  S.  By 
T  C  S  we  mean  each  element  of  T  also  belongs  to  S,  i.e.,  x  G  T 
implies  iGS,  Thus  we  have  1  G  N,  17  6  N,  —  3  ^  N,  ^  ^  N,  \/2  ^  N, 
2  G  Q,  5  G  M,  \/2  G  M,  \/2  ^  Q,  and  n  G  M.  Also  we  have  NCR, 
QCR,  and  M  C  M. 

Small  finite  sets  can  be  listed  using  braces  {  }.  For  example, 
{2, 3,  5,  7}  is  the  four-element  set  consisting  of  the  primes  less  than 
10.  Sets  are  often  described  by  properties  of  their  elements  via  the 
notation 


{  =  }• 

Before  the  colon  the  variable  [n  or  x,  for  instance]  is  indicated  and 
after  the  colon  the  properties  are  given.  For  example, 

{n  :  n  G  N  and  n  is  odd}  (1) 

represents  the  set  of  positive  odd  integers.  The  colon  is  always  read 
“such  that,”  so  the  set  in  (1)  is  read  “the  set  of  all  n  such  that  n  is 
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in  N  and  n  is  odd.”  Likewise 

{z  :  z  E  M  and  1  <  x  <  3}  (2) 

represents  the  set  of  all  real  numbers  greater  than  or  equal  to  1  and 
less  than  3.  In  §4  this  set  is  abbreviated  [1,  3).  Note  that  1  G  [1,3)  but 
3  ^  [1,3).  Just  to  streamline  notation,  the  expressions  (1)  and  (2) 
may  be  written  as 

{n  E  N  :  n  is  odd}  and  {z  6  K  :  1  <  x  <  3}. 

The  first  set  is  then  read  “the  set  of  all  n  in  N  such  that  n  is  odd.” 

Another  way  to  list  a  set  is  to  specify  a  rule  for  obtaining  its 
elements  using  some  other  set  of  elements.  For  example,  {n2  :  n  E  N} 
represents  the  set  of  all  positive  integers  that  are  the  square  of  other 
integers,  i.e. , 

(n2  :  n  E  N}  =  (m  E  N  :  m  =  n2  for  some  n  €  N}  =  (1, 4, 9, 16, 25, . . .}. 

Similarly  {sin  ^  :  n  E  N}  represents  the  set  obtained  by  evaluating 
sin  ™  for  each  positive  integer  n.  Actually  this  set  is  finite: 


The  set  in  (1)  can  also  be  written  as  {2n  -  1  :  n  E  N}.  One  more 
example:  {z3  :  z  >  3}  is  the  set  of  all  cubes  of  all  real  numbers 
bigger  than  3  and  of  course  equals  {y  E  M  :  y  >  27},  i.e.,  (27,  oo)  in 
the  notation  of  §5. 

For  sets  S  and  T,  S  \  T  signifies  the  set  {z  E  S  :  x  ^  T}.  For 
a  sequence  (An)  of  sets,  the  union  U An  and  intersection  n An  are 
defined  by 

An  =  {z  :  z  E  An  for  at  least  one  n}, 

P|  An  =  {z  :  z  E  An  for  all  n}. 

The  empty  set  0  is  the  set  with  no  elements  at  all.  Thus,  for  example, 
{n  E  N  :  2  <  n  <  3}  =  0,  {r  E  Q  :  r2  =  2}  =  0,  {z  E  M  :  z2  < 
0}  =  0,  and  [0,  2]  n  [5,  oo)  =  0. 

For  functions  /  and  g,  the  notation  f+g,  fg ,  fog ,  etc.  is  explained 
on  page  128. 

The  end  of  a  proof  is  indicated  by  a  small  black  box.  This  replaces 
the  classical  QED. 
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Notice.  These  hints  and  answers  should  be  consulted  only  after  serious 
attempts  have  been  made  to  solve  the  problems.  Students  who  ignore  this 
advice  will  only  cheat  themselves. 

Many  problems  can  be  solved  in  several  ways.  Your  solution  need  not 
agree  with  that  given  here.  Often  your  solution  should  be  more  elaborate. 

1.1  Hint:  The  following  algebra  is  needed  to  verify  the  induction  step: 

2  n2  +  n 

- - - hn  +  1  =  ••• 

6 

n  +  2)  (2  n  +  3) 

6  ' 

1.3  Hint:  Suppose  the  identity  holds  for  n.  Then  work  on  the  right  side 
of  the  equation  with  n+1  in  place  of  n.  Since  ( x+y )2  =  x2  +2xy+y2 , 

(1  T  2  +  •  ■  ■  — 1—  n  — (—  {n  +  1))  =  (1  +  2  +  •  •  •  +  n)2 

+2(n+l)(l  +  2  +  ■■■n)  +  (n  +  1)2. 

Use  Example  1  to  show  the  second  line  has  sum  (n  +  1  )3;  hence 

(1+2-1 - b(n+l))2  =  (1+2+-  •  •  n)2+(n+l)3  =  13+23H - b(n+l)3. 

1.5  Hint:  2  —  ^-  +  =  2  —  jAr- 

1.7  Hint:  7n+1~ -  6(n  +  1)  -  1  =  7(7"  -  6n  -  1)  +  36n. 
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n(n  +  l)(2n  +  1) 


+  (n  +  l)2  =  (n  +  1) 
(n  +  l)( 
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1.9  (a)  n  >  5  and  also  n  =  1. 

(b)  Clearly  the  inequality  holds  for  n  =  5.  Suppose  2n  >  n2  for 
some  n  >  5.  Then  2n+1  =  2  ■  2n  >  2n2,  so  2n+1  >  [n  +  l)2 
provided  2n2  >  (n  +  l)2  or  n2  >  2n  +  1  for  n  >  5.  In  fact,  this 
holds  for  n  >  3,  which  can  be  verified  using  calculus  or  directly: 
n2  >  3n  =  2n  +  n  >  2n  +  l. 

1.11  (a)  Hint:  If  n2  +  5n  +  1  is  even,  then  so  is  (n  +  l)2  +  5(n  +  1)  +  1  = 
n2  +  5n  +  1  +  [2n  +  6] . 

(b)  Pn  is  false  for  all  n.  Moral:  The  basis  for  induction  (Ii)  is  crucial 
for  mathematical  induction. 

2.1  Hint:  Imitate  Example  3.  You  should,  of  course,  verify  your  asser¬ 
tions  concerning  nonsolutions.  Note  there  are  16  rational  candidates 
for  solving  x2  —  24  =  0. 

2.3  Hint:  \J 2  +  \[2  is  a  solution  of  x4  —  4a:2  +  2  =  0. 

2.5  Hint:  [3  +  \/2]2^3  is  a  solution  of  a:6  —  22a;3  +  49  =  0. 

2.7  (a)  Show  x  =  \J \  +  2\f?>—  \/3  satisfies  the  quadratic  equation  x2  + 
2x\f?>—  1  —  2-\/3  =  0.  Alternatively,  start  with  the  observation 
(V/4  +  2v/3)2  =  4  +  2\f?>  =  1  +  2^3  +  3  =  (1  +  V3)2. 

(b)  2. 

3.1  (a)  A3  and  A4  hold  for  a  £  N,  but  0  and  —a  are  not  in  N.  Like¬ 

wise  M4  holds  for  a  £  N,  but  a-1  is  not  in  N  unless  a  =  1. 
These  three  properties  fail  for  N  since  they  implicitly  require 
the  numbers  0,  —a  and  a-1  to  be  in  the  system  under  scrutiny, 
namely  N  in  this  case. 

(b)  M4  fails  in  the  sense  discussed  in  (a). 

3.3  (iv)  Apply  (iii),  DL,  A2,  A4,  (ii)  and  A4  again  to  obtain 

(— a)(— 6)  +  (—ab)  =  (—a)(—b)  +  ( -a)b=  (-a)[(-6)  +  b) 

=  (—a)[b  +  (—6)]  =  (—a)  •  0  =  0  =  ab  +  (— ab ). 


Now  by  (i)  we  conclude  (— a)(— b)  =  ab. 

(v)  Suppose  ac  =  be  and  c  ^  0.  By  M4  there  exists  c_1  such  that 
c  •  c_1  =  1.  Now  (supply  reasons) 

a  =  a- 1  =  a(c-c_1)  =  (ac)c_1  =  ( bc)c~ 1  =  6(c-c_1)  =  b-1  =  b. 

(a)  If  |6|  <  a,  then  —a  <  — 16|,  so  —a  <  — 16|  <  b  <  \b\  <  a.  Now 
suppose  —a  <  b  <  a.  If  b  >  0,  then  |&|  =  b  <  a.  If  b  <  0,  then 
|&|  =  —6  <  a;  the  last  inequality  holds  by  Theorem  3.2(i)  since 
—a  <  b. 


3.5 
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(b)  By  (a),  it  suffices  to  prove  — |o  —  b\  <  |a|  —  |6|  <  \a  —  b\.  Each 
of  these  inequalities  follows  from  the  triangle  inequality:  |6|  = 
|(6  —  a)  +  a\  <  |6  —  a|  +  |o|  =  |a  —  b\  +  |o|  which  implies  the  first 
inequality;  |a|  =  |(a  —  6)  +  b\  <  \a  —  b\  +  |6|  which  implies  the 
second  inequality. 

3.7  (a)  Imitate  the  answer  to  Exercise  3.5(a). 

(b)  By  (a),  |a  —  b\  <  c  if  and  only  if  —  c  <  a  —  b  <  c,  and  this 
obviously  holds  [see  04]  if  and  only  if6^c<a<6  +  c. 

4.1  If  the  set  is  bounded  above,  use  any  three  numbers  >  supremum  of 
the  set;  see  the  answers  to  Exercise  4.3.  The  sets  in  (h),  (k)  and  (u) 
are  not  bounded  above.  Note  the  set  in  (i)  is  simply  [0, 1]. 

4.3  (a)  1;  (c)  7;  (e)  1;  (g)  3;  (i)  1;  (k)  No  sup;  (m)  2;  (o)  0;  (q)  16; 
(s)  |;  (u)  No  sup;  (w)  In  (s),  note  1  is  not  prime. 

4.5  Proof  Since  sup  S  is  an  upper  bound  for  S,  we  have  sup  S'  >  s 
for  all  s  £  S.  Also  supS  £  S  by  assumption.  Hence  supS  is  the 
maximum  of  S,  i.e. ,  supS  =  maxS. 

4.7  (a)  Suppose  S  C  T.  Since  supT  >  t  for  all  t  €  T  we  obviously 

have  supT  >  s  for  all  s  £  S.  So  supT  is  an  upper  bound  for 
the  set  S.  Hence  supT  is  >  the  least  upper  bound  for  S,  i.e., 
supT  >  sup S.  A  similar  argument  shows  inf  T  <  inf  S;  give  it. 
(b)  Since  S  C  S  U  T,  supS  <  sup(S  U  T)  by  (a).  Similarly 
supT  <  sup(SUT),  so  maxjsupS, supT}  <  sup(SUT).  Since 
sup(S  U  T)  is  the  least  upper  bound  for  S  U  T,  we  will  have 
equality  here  provided  we  show:  maxjsupS, supT}  is  an  up¬ 
per  bound  for  the  set  S  U  T.  This  is  easy.  If  x  £  S,  then 
x  <  supS  <  maxjsupS, supT}  and  if  x  £  T,  then  x  < 
supT  <  maxjsupS, supT}.  That  is,  x  <  max{ sup S, supT} 
for  all  x  £  S  U  T. 

4.9  (1)  If  s  £  S,  then  —  s  £  — S,  so  —  s  <  sq.  Hence  we  have  s  >  —sq 
by  Theorem  3.2(i). 

(2)  Suppose  t  <  s  for  all  s  £  S.  Then  —t  >  —  s  for  all  s  £  S,  i.e., 
—t>  x  for  all  x  £  — S.  So  —t  is  an  upper  bound  for  the  set  — S. 
So  —t  >  sup( — S) .  That  is,  —  t  >  sq  and  hence  t  <  —Sq. 

4.11  Proof  By  4.7  there  is  a  rational  r\  such  that  a  <  r\  <  b.  By  4.7 
again,  there  is  a  rational  f2  such  that  a  <  <  r±.  We  continue  by 

induction:  If  rationals  n, . . . ,  rn  have  been  selected  so  that  a  <  rn  < 
rn- 1  <  •  ■  •  <  V2  <  r\,  then  4.7  applies  to  a  <  rn  to  yield  a  rational 
rn+ 1  such  that  a  <  rn+\  <  rn.  This  process  yields  an  infinite  set 
{n,r2, .. .}  in  Qn  (a,  6). 
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Alternative  Proof  Assume  Qfl  (a,  b)  is  finite.  The  set  is  nonempty 
by  4.7.  Let  c  =  min(Q  D  (a,  b)).  Then  a  <  c,  so  by  4.7  there  is  a 
rational  r  such  that  a  <  r  <  c.  Then  r  belongs  to  Qfl  (a,  b),  so  c  <  r, 
a  contradiction. 

4.13  By  Exercise  3.7(b),  we  have  (i)  and  (ii)  equivalent.  The  equivalence 
of  (ii)  and  (iii)  is  obvious  from  the  definition  of  an  open  interval. 

4.15  Assume  a  <  b  +  ^  for  all  n  £  N  but  a  >  b.  Then  a  —  b  >  0,  and 
by  the  Archimedean  property  4.6  we  have  no  (a  —  b)  >  1  for  some 
n o  £  N.  Then  a  >  b  +  —  contrary  to  our  assumption. 


5.1 
5.3 
5.5 

5.7 

6.1 


6.3 


6.5 


7.1 


7.3 


7.5 


(a)  (-oo,0);  (b)  (— oo,  2];  (c)  [0,oo);  (d)  (~y/8,V8). 

Hint:  The  unbounded  sets  are  in  (h),  (k),  (1),  (o),  (t)  and  (u). 
Proof  Select  So  €  S.  Then  inf  S  <  sq  <  sup  S  whether  these 
symbols  represent  ±oo  or  not. 

Use  Exercise  5.4  and  the  fact  —  {A  +  B)  =  (—A)  +  ( —B ). 

If  s  <  t,  then  clearly  s*  C  t* .  Conversely,  assume  s*  C  t*  but 
that  s  >  t.  Then  t  £  s*  but  t  0  t*,  a  contradiction. 
s  =  t  if  and  only  if  both  s  <  t  and  t  <  s  if  and  only  if  both 
s*  C  t*  and  t*  C  s*  if  and  only  if  s*  =  t*. 

If  r  €  a  and  s  €  0*,  then  r  +  s  <  r,  so  r  +  s  £  a.  Hence 
a  +  0*  C  a.  Conversely,  suppose  r  £  a.  Since  a  has  no  largest 
element,  there  is  a  rational  t  €  a  such  that  t  <  r.  Then  r  —  t  is 
in  0*,  so  r  =  t  +  (r  —  t)  £  a  +  0*.  This  shows  a  C  a  +  0*. 

—a  =  {r  £  Q  :  s  ^  a  for  some  rational  s  <  —  r}. 

No;  it  corresponds  to  s/2. 

This  is  the  Dedekind  cut  corresponding  to  y/2. 
l  l  j_  J_  J_ 

4’  7>  10’  13’  16 
1  2  1  4_  _5_ 

3  ’  9  >  9  >  81  ’  243 

(a)  converges  to  1;  (c)  converges  to  0;  (e)  does  not  converge;  (g) 
does  not  converge;  (i)  converges  to  0;  (k)  does  not  converge;  (m) 
converges  to  0  [this  sequence  is  (0, 0, 0, . . .)];  (o)  converges  to  0;  (q) 
converges  to  0  [see  Exercise  9.15];  (s)  converges  to  | 

(a)  Has  limit  0  since  sn  =  l/(y/n2  +  1  +  n). 

(c)  \J An2 


(a) 

(b) 

(a) 


(b) 

(b) 

(c) 

(a) 

(c) 


+  n—  2n  =  n/(-\/4n2  +  n  +  2n)  and  this  is  close  to 


for  large  n.  So  limit  appears  to  be  |; 


2n+2n 


it  is. 


8.1  (a)  Formal  Proof  Let  e  >  0.  Let  N  =  -.  Then  n  >  N  implies 


I  (-!)"■ 
I  n- 0 


=  i  <  e. 


(b)  Discussion.  We  want  n-1/3  <  t  or  )  <  e3  or  1/e3  <  n.  So 
for  each  e  >  0,  let  N  =  1/e3.  You  should  write  out  the  formal 
proof. 
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(c)  Discussion.  We  want 


I  2n-l 


<  e  or 


-7 


<  e  or 


3n+2  3  I  c  l(3n+2)-3l 

<  e  or  <  3n  +  2  or  2-  —  |  <  n.  So  set  N  equal 


3(3n+2) 

tol-2 
t0  9e  3  ' 

(d)  Discussion.  We  want  (n  +  6)/(n2  —  6)  <  e;  we  assume  n  >  2 
so  that  absolute  values  can  be  dropped.  As  in  Example  3  we 
observe  n  +  6  <  7 n  and  n2  —  6  >  |n2  provided  n  >  3.  So 
it  suffices  to  get  7 n/(|n2)  <  e  [for  n  >  3]  or  —  <  n.  So  try 
A"  =  max{3,  ^}. 

8.3  Discussion.  We  want  <  e  or  sn  <  e2.  But  sn  — »■  0,  so  we  can  get 
s„  <  e2  for  large  n. 

Formal  Proof  Let  e  >  0.  Since  e2  >  0  and  lim  sn  =  0,  there  exists 
N  so  that  |s„  —  0|  <  e2  for  n  >  N .  Thus  sn  <  e2  for  n  >  N,  so 

<  e  for  n  >  N.  That  is,  \y/s^  —  0|  <  e  for  n  >  N.  We  conclude 

lim  =  0. 

8.5  (a)  Let  e  >  0.  Our  goal  is  to  show  s  —  e  <  sn  <  s  +  e  for  large 

n.  Since  liman  =  s,  there  exists  N\  so  that  \an  —  s|  <  e  for 
n>  N\.  In  particular, 

n  >  Ni  implies  s  —  e  <  an.  (1) 

Likewise  there  exists  IV2  so  that  \bn  —  s|  <  e  for  n  >  N2,  so 

n>  N2  implies  bn  <  s  +  e.  (2) 

Now 

n  >  maxjA-!, ^2}  implies  s  —  e  <  an  <  sn  <  bn  <  s  +  e; 
hence  |s  —  sn|  <  e. 

(b)  It  is  easy  to  show  lim(— tn)  =  0  if  limi„  =  0.  Now  apply  (a)  to 
the  inequalities  —  tn  <  sn  <tn. 

8.7  (a)  Assume  limcos(I^L)  =  a.  Then  there  exists  N  such  that  n>  N 
implies  |  cos(^)  —  o|  <  1.  Consider  n  >  N  and  n  +  3  where 
n  is  a  multiple  of  6;  substituting  these  values  in  the  inequality 
gives  1 1  —  a|  <  1  and  |  —  1  —  a|  <  1 .  By  the  triangle  inequality 

2  =  |(1  -  a)  -  (-1  -  o)|  <  |1  -  a\  +  |  -  1  -  a|  <  1  +  1  =  2, 

a  contradiction. 

(b)  Assume  lim(—  l)nn  =  a.  Then  there  exists  N  such  that  n  >  N 
implies  |(— l)nn  —  a|  <  1.  For  an  even  n  >  N  and  for  n  +  2  this 
tells  us  |n— a|  <  1  and  |n+2— a|  <  1.  So  2  =  |n+2— a—  (n— a)\  < 
In  +  2  —  a|  +  In  —  a|  <  2,  a  contradiction. 
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(c)  Note  the  sequence  takes  the  values  ±  for  large  n.  Assume 
limsin(I7:)  =  a.  Then  there  is  N  such  that 


n  >  N  implies  |  sin 


.  /  T17T  \  VS 

ml  —  I  —  a  <  — 


V  3  7 


Substituting  suitable  n  >  N,  we  obtain 
By  the  triangle  inequality 


vH 


—  a 


<  ^  and 


Vs  = 


Vs 

2 


' —Vs' 


Vs 

< 

-Y~a 

+ 

a  — 


VS  VS  ^  r- 

<  ~2  +  T  ■ 


a  contradiction. 

8.9  (a)  Hint :  There  exists  No  in  N  such  that  sn  >  a  for  n  >  Nq. 

Assume  s  =  lims^  and  s  <  a.  Let  e  =  a  —  s  and  select  N  >  No 
so  that  |s„  —  s |  <  e  for  n  >  N.  Show  sn  <  a  for  n  >  TV;  a 
picture  might  help. 

9.1  (a)  lim(g±l)  =  lim(l  +  £)  =  lim  1  +  lim ±  =  1  +  0  =  1.  The  sec¬ 
ond  equality  is  justified  by  Theorem  9.3  and  the  third  equality 
follows  from  Theorem  9.7(a). 

(b)  lim(3n  +  7) / (6 n  —  5)  =  lim(3  +  7/n)/(6  —  5/n)  =  lim(3  + 
7/n)/lim(6— 5/n)  =  (Iim3+7dim(l/n))/(lim6—  5dim(l/n))  = 
(3  +  7 •  0)/(6  —  5-0)  =  The  second  equality  is  justified  by  The¬ 

orem  9.6,  the  third  equality  follows  from  Theorems  9.3  and  9.2, 
and  the  fourth  equality  uses  Theorem  9.7(a). 

9.3  First  we  use  Theorem  9.4  twice  to  obtain  lima3  =  lima„  •  lima);  = 
a  •  lima);  =  a  ■  liman  -  liman  =  a  ■  a  •  a  =  a3.  By  Theorems  9.3 
and  9.2,  we  have  lim(a3  +  4an)  =  lima3  +  4  •  liman  =  a3  +  4a. 
Similarly  lim (fr2  +  1)  =  lim  bn  •  lim  bn  +  1  =  b2  +  1.  Since  b2  +  1^0, 
Theorem  9.6  shows  lims„  =  (a3  +  4a)/(&2  +  1). 

9.5  Hint :  Let  t  =  lim  tn  and  show  t  =  (t2  +  2)/2 1.  Then  show  t  =  V%- 

9.7  It  has  been  shown  that  sn  <  -y/ 2 / (?z  —  1)  for  n  >  2,  and  we  need  to 
prove  limsn  =  0. 

Discussion.  Let  e  >  0.  We  want  sn  <  e,  so  it  suffices  to  get 
V% /{n  —  1)  <  e  or  2/(n  -  1)  <  e2  or  2e-2  +  1  <  n. 

Formal  Proof.  Let  e  >  0  and  let  N  =  2e_2  +  l.  Then  n  >  N  implies 
<  y/2/(n  —  1)  <  \/2/(2e  2  +  1-1)  =  e. 
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9.9  (a)  Let  M  >  0.  Since  lims^  =  +oo  there  exists  N  >  Nq  such  that 
sn  >  M  for  n  >  N.  Then  clearly  tn  >  M  for  n  >  N,  since 
sn  <  tn  for  all  n.  This  shows  limtn  =  +oo. 

(c)  Parts  (a)  and  (b)  take  care  of  the  infinite  limits,  so  assume 
(sn)  and  (tn)  converge.  Since  tn  —  sn  >  0  for  all  n  >  No, 
lim(in  —  sn )  >  0  by  Exercise  8.9(a).  Hence  limfn  —  limsn  >  0 
by  Theorems  9.3  and  9.2. 

9.11  (a)  Discussion.  Let  M  >  0  and  let  m  =  inf{fn  :  n  £  N}.  We  want 
sn  +tn  >  M  for  large  n,  but  it  suffices  to  get  sn  +  m  >  M  or 
sn  >  —  m  for  large  n.  So  select  N  so  that  sn  >  M  —  m  for 

n>  N. 

(b)  Hint :  If  limtn  >  — oo,  then  inf{tn  :  n  £  N}  >  —  oo.  Use  part  (a). 

9.13  If  |a|  <  1,  then  lima"  =  0  by  Theorem  9.7(b).  If  a  =  1,  then 
obviously  lima"  =  1. 

Suppose  a  >  1.  Then  ~  <  1,  so  lim(l/a)n  =  0  as  above.  Thus 
lim  l/an  =  0.  Theorem  9.10  [with  sn  =  an ]  now  shows  lima"  =  +oo. 
[This  case  can  also  be  handled  by  applying  Exercise  9.12.] 

Suppose  a  <  —  1  and  assume  lima"  exists.  For  even  n,  a"  >  1  and 
for  odd  n,  an  <  —  1.  Clearly  lima"  =  +oo  and  lima"  =  —  oo  are 
impossible.  Assume  lim  a"  =  A  for  a  real  number  A.  There  exists  N 
such  that  | a"  —  A\  <  1  for  n  >  N.  For  even  n  this  implies  A  >  0  and 
for  odd  n  this  implies  A  <  0,  a  contradiction. 

9.15  Apply  Exercise  9.12  with  sn  =  an/n\.  Then  L  =  lim  [s^+i/snl  = 
lim  ^j-  =  0,  so  lim  sn  =  0. 

9.17  Discussion.  Let  M  >  0.  We  want  n2  >  M  or  n  >  \[M.  So  let 
N  =  VM. 

10.1  increasing:  (c);  decreasing:  (a),  (f);  bounded:  (a),  (b),  (d),  (f). 

10.3  The  equality  in  the  hint  can  be  verified  by  induction;  compare 
Exercise  1.5.  Now  by  (1)  in  Discussion  10.3  we  have 


=  K+  — 
10 


dn 

1(7 


<  K  -\ - 

10 


-  <K+  1. 

10" 


10.7  Let  t  =  sup  S'.  For  each  n  £  N,  t  —  ~  is  not  an  upper  bound  for  S, 
so  there  exists  sn  satisfying  t  —  -  <  sn  <  t.  Now  apply  the  squeeze 
lemma  in  Exercise  8.5. 

10.9  (a)  s2  =  5,  s3  =  g,  S4  =  is- 
(b)  First  we  prove 


0  <  sn+  i  <  sn  <  1  for  all  n  >  1. 


(1) 
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This  is  obvious  from  part  (a)  for  n  =  1,2,3.  Assume  (1)  holds 
for  n.  Then  sn+±  <  1,  so 


Sn+2 


n  +  1  2  _  f  n+1  \ 

W+2Sn+1  ~  V7+2S,l+V  Sn+1  <  Sn+1 


since  (^±|)sn+i  <  1.  Since  sra+i  >  0  we  also  have  sn+2  >  0. 
Hence  0  <  sn+2  <  Sn+i  <  1  and  (1)  holds  by  induction. 
Assertion  (1)  shows  (sn)  is  a  bounded  monotone  sequence,  so 
(s„)  converges  by  Theorem  10.2. 

(c)  Let  s  =  limsn.  Using  limit  theorems  we  find  s  =  limSn+i  = 
lim  ^qbj-  •  lims^  =  s2 .  Consequently  s  =  1  or  s  =  0.  But  s  =  1 
is  impossible  since  sn  <  \  for  n  >  2.  So  s  =  0. 

10.11  (a)  Show  ( tn )  is  a  bounded  monotone  sequence. 

(b)  The  answer  is  not  obvious!  It  turns  out  that  limt„  is  a  Wallis 
product  and  has  value  ^  which  is  about  0.6366.  Observe  how 
much  easier  part  (a)  is  than  part  (b). 


11.1  (a)  1,  5,  1,  5,  1,  5,  1,  5 

(b)  Let  cr(fc)  =  rife  =  2k.  Then  ( ank )  is  the  sequence  that  takes  the 
single  value  5.  [There  are  many  other  possible  choices  of  o\] 

11.3  (b)  For  (sn),  the  set  S  of  subsequential  limits  is{— 1,  — 1,|,1}.  For 
C tn ),  s  =  {0}.  For  (un),  S  =  {0}.  For  (/y„),  S  =  {-1, 1}. 

(c)  lim  sup  sn  =  1,  liminfsn  =  —1,  lim  sup  tn  =  lim  inf  tn  = 
limt„  =  0,  lim  sup  un  =  lim  inf  un  =  limun  =  0,  limsupt?n  =  1, 
lim  inf  vn  =  —  1 . 

(d)  (tn)  and  ( un )  converge. 

(e)  (s„),  (tn),  ( un )  and  ( vn )  are  all  bounded. 

11.5  (a)  [0,1];  (b)  limsupqv!  =  1,  liminfq,Il  =  0. 

11.7  Apply  Theorem  11.2. 

11.9  (a)  To  show  [a,  b]  is  closed,  we  need  to  consider  a  limit  s  of  a  con¬ 
vergent  sequence  (sn)  from  [a,  b]  and  show  s  is  also  in  [a,  b ].  But 
this  was  done  in  Exercise  8.9. 

(b)  No!  (0,1)  is  not  closed,  i.e.,  (0,1)  does  not  have  the  property 
described  in  Theorem  11.9.  For  example,  tn  =  -  defines  a 
sequence  in  (0, 1)  such  that  t  =  limt„  does  not  belong  to  (0, 1). 

11.11  Let  t  =  sup^.  There  are  several  ways  to  prove  the  result.  (1) 
Provide  an  inductive  definition  where  Sk  >  max{sfc_i,f  —  j:}  for 
all  k.  (2)  Apply  Theorem  11.2  directly.  (3)  Use  the  sequence  (sn) 
obtained  in  Exercise  10.7,  and  show  tn  =  max{si, . . . ,  sn}  defines  an 
increasing  sequence  ( tn )  in  S  converging  to  t. 
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12.1  Let  Un  =  inf{sn  :  n  >  N}  and  wn  =  inf{f„  :  n  >  N}.  Then  ( un ) 
and  (in at)  are  increasing  sequences  and  un  <  wn  for  all  N  >  No- 
By  Exercise  9.9(c),  lim  inf  sn  =  limujv  <  limuijv  =  limin£t„.  The 
inequality  lim  sup  sn  <  lim  sup  tn  can  be  shown  in  a  similar  way  or 
one  can  apply  Exercise  11.8. 

12.3  (a)  0;  (b)  1;  (c)  2;  (d)  3;  (e)  4;  (f)  0;  (g)  2. 

12.5  By  Exercise  12.4,  limsup(— sn  —  tn)  <  limsup(— sn)  +  limsup(— tn), 
so  —  limsup(—  (sn  +  tn ))  >  —  limsup(— sn)  +  [—  lim sup(— tn)\.  Now 
apply  Exercise  11.8. 

12.7  Let  (snj.)  be  a  subsequence  of  ( sn )  such  that  lim^oo  snj  =  +oo.  [We 
used  j  here  instead  of  k  to  avoid  confusion  with  the  given  k  >  0.] 
Then  lim^oo  ksnj  =  +oo  by  Exercise  9.10(a).  Since  ( ksnj )  is  a 
subsequence  of  ( ksn ),  we  conclude  limsup(fcsn)  =  +oo. 

12.9  (a)  Since  lim  inf  tn  >  0,  there  exists  Ni  such  that  m  =  inf{tn  :  n  > 
Ni}  >  0.  Now  consider  M  >  0.  Since  lims^  =  Too,  there  exists 
N2  such  that  sn  >  ^  for  n  >  N2.  Then  n  >  max{./Vi,  ^2} 
implies  sntn  >  {^)tn  >  (^)m  =  M.  Hence  lims„tn  =  +00. 

12.11  Partial  Proof  Let  M  =  lim  inf  |sn+i/sn|  and  (3  =  lim  inf  \sn\1tn. 
To  show  M  <  /3,  it  suffices  to  prove  M\  <  /3  for  all  Mi  <  M .  Since 


lim  inf 


^n+l 

Sn 


lim  inf 

N—t  00 


there  exists  N  such  that 


^n+1 

Sn 


:  n  >  N 


>  Mi, 


inf 


^n+l 

Sn 


:  n>  N 


>  Mi. 


Now  imitate  the  proof  in  Theorem  12.2,  but  note  that  many  of  the 
inequalities  will  be  reversed. 

12.13  Proof  of  sup  A  =  lim  inf  sn.  Consider  N  in  N  and  observe  Un  = 
inf{s„  :  n  >  N}  is  a  number  in  A,  since  {n  €  N  :  sn  <  Un}  Q 
{1,2,...,  N}.  So  Un  <  sup  A  for  all  N  and  consequently  lim  inf  sn  = 
lim  un  <  sup  A. 

Next  consider  a  £  A.  Let  No  =  max{n  e  N  :  sn  <  a}  <  00.  Then 
sn  >  a  for  n  >  No-  Thus  for  N  >  Nq  we  have  Un  =  inf{s„  : 
n  >  N}  >  a.  It  follows  that  lim  inf  sn  =  lirnuAr  >  a.  We  have  just 
shown  that  lim  inf  sn  is  an  upper  bound  for  the  set  A.  Therefore 
lim  inf  sn  >  sup  A. 

13.1  (a)  It  is  clear  that  di  and  c?2  satisfy  D1  and  D2  of  Definition  13.1. 

If  a;,  y,  z  £  Rfc,  then  for  each  j  =  1, 2, . . . ,  k, 


I Xj  -Zj I  <  \xj  -Vj\  +  | Vj  Zj |  <  di(x,y)+di(y,z), 
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so  di(x,z)  <  di(x,y)  +  di(y,z).  So  d\  satisfies  the  triangle 
inequality  and  a  similar  argument  works  for  d2]  give  it. 

(b)  For  the  completeness  of  d\  we  use  Theorem  13.4  and  the 
inequalities 

di(x,y)  <  d(x,y)  <  Vkdx{x,y). 

In  fact,  if  (xn)  is  Cauchy  for  d\,  then  the  second  inequality 
shows  (xn)  is  Cauchy  for  d.  Hence  by  Theorem  13.4,  for  some 
x  £  Rfc  we  have  lim  d(xn,x)  =  0.  By  the  first  inequality,  we 
also  have  \imdi(xn ,  x)  =  0,  i.e. ,  (xn)  converges  to  x  in  the  met¬ 
ric  d\.  For  d2,  use  the  completeness  of  d\  and  the  inequalities 
di(x,y)  <  d-2{x,y)  <  kdi{x,y). 

13.3  (b)  No,  because  d*(x,y)  need  not  be  finite.  For  example,  consider 
the  elements  x  =  (1, 1,1,.. .)  and  y  =  (0, 0,  0, . . .). 

13.7  Outline  of  Proof  Consider  an  open  set  U  C  R.  Let  (qn)  be  an 
enumeration  of  the  rationals  in  U.  For  each  n,  let 

an  =  inf{a  £  K  :  {a,qn]  C  [/},  bn  =  sup{6  £  K  :  [qn,b)  C  U}. 

Show  (an,bn)  C  U  for  each  n  and  U  =  U^Li(an; bn).  Show 

(Un;  ^n)  C  (Urn)  ^m)  7^  ^  implies  (un,  bn)  —  (um,  &m). 

Now  either  there  will  be  only  finitely  many  distinct  [and  disjoint]  in¬ 
tervals  or  else  a  subsequence  {(ank ,  bnic)}’^=1  of  {(an,  bn)}  will  consist 
of  disjoint  intervals  for  which  Ufc°=i(a«fe  >  bnk)  =  U. 

13.9  (a)  {i  :  n  £  N}  U  {0};  (b)  R;  (c)  [-y/2,  y/2]. 

13.11  Suppose  E  is  compact,  hence  closed  and  bounded  by  Theorem  13.12. 
Consider  a  sequence  (xn)  in  E.  By  Theorem  13.5,  a  subsequence  of 
( xn )  converges  to  some  x  in  Rfc.  Since  E  is  closed,  x  must  be  in  E\ 
see  Proposition  13.9(b). 

Suppose  every  sequence  in  E  has  a  subsequence  converging  to  a 
point  in  E.  By  Theorem  13.12,  it  suffices  to  show  E  is  closed  and 
bounded.  If  E  were  unbounded,  E  would  contain  a  sequence  (xn) 
where  limd(a3„,0)  =  +oo  and  then  no  subsequence  would  converge 
at  all.  Thus  E  is  bounded.  If  E  were  nonclosed,  then  by  Proposi¬ 
tion  13.9  there  would  be  a  convergent  sequence  (xn)  in  E  such  that 
x  =  lima;n  ^  E.  Since  every  subsequence  would  also  converge  to 
x  qL  E,  we  would  have  a  contradiction. 
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13.13  Assume,  for  example,  that  supl?  ^  E.  The  set  E  is  bounded,  so  by 
Exercise  10.7,  there  exists  a  sequence  (sn)  in  E  where  lim  sn  =  sup  E. 
Now  Proposition  13.9(b)  shows  supl?  £  E,  a  contradiction. 

13.15  (a)  F  is  bounded  because  d(x,0)  <  1  for  all  x  £  F  where  0  = 
(0, 0,  0, . . .).  To  show  F  is  closed,  consider  a  convergent  sequence 
(x(n))  in  F.  We  need  to  show  x  =  liman”)  is  in  F.  For  each 
3  =  1,2,. 


,  it  is  easy  to  see  lim„_>.00  x^1'  =  Xj .  Since  each 
x ^  belongs  to  [—1, 1],  Xj  belongs  to  [—1, 1]  by  Exercise  8.9.  It 
follows  that  x  £  F. 

For  the  last  assertion  of  the  hint,  observe 


(b) 


x 


(”),  a?(m)  in  U{x)  implies  d(x 


(n) 


x (m>)  <  d{x^n\x)  + 

2  for  m  7^  n.  Now  show 


14.1 


d(x1x(jn'>)  <  2  while  d(x^n\x^m'>) 
no  finite  subfamily  of  U  can  cover  (a7ra)  :  n  £  N}. 

(a),  (b),  (c)  Converge;  use  Ratio  Test. 

(d)  Diverges;  use  Ratio  Test  or  show  nth  terms  don’t  converge  to 
0  [see  Corollary  14.5]. 

(e)  Compare  with  ^3  1  /n2. 

(f)  Compare  with  n- 

14.3  All  but  (e)  converge. 

14.5  (a)  We  assume  the  series  begin  with  n  =  1.  Let  sn  =  ]C"_i  a,j 
and  tn  =  bj-  We  are  given  lim  sn  =  A  and  lim  tn  =  B. 

Hence  lim(s„  +  tn)  =  A  +  B  by  Theorem  9.3.  Clearly  sn  + 
tn  =  Ylj=i (dj  +  bj)  is  the  nth  partial  sum  for  J2(an  +  bn),  so 
J2ian  +  bn)  =  lim(s„  +  tn)  =  A  +  B. 

(c)  The  conjecture  is  not  even  reasonable  for  series  of  two  terms: 
ai&i  +  a2b-2  7^  (ai  +  a2)(&i  +  b2). 

14.7  By  Corollary  14.5,  there  exists  N  such  that  an  <  1  for  n  >  N.  Since 
p  >  1,  a?  =  a„aP_1  <  an  for  n  >  N.  Hence  S^Ljv+i  an  converges 
by  the  Comparison  Test,  so  an  also  converges. 

14.9  Hint:  Let  Nq  =  max{n  £  N  :  an  7^  bn}  <  00.  If  n  >  m  >  Nq,  then 


En  7 

k=m  Q’k  2-~/k=m 

14.11  Assume  an+i/an  =  r  for  n  >  1.  Then  a2  =  ra  1,  0,3  =  r2a2,  etc. 
A  simple  induction  argument  shows  an  =  rn~1a  1  for  n  >  1.  Thus 
an  =  airn_1  is  a  geometric  series. 

14.13  (a)  2  and  -§. 

(b)  Note 
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since  the  intermediate  fractions  cancel  out.  Hence  limsn  =  1. 

(d)  2. 

15.1  (a)  Converges  by  Alternating  Series  Theorem. 

(b)  Diverges;  note  lim(n!/2n)  =  +oo  by  Exercise  9.12(b). 

15.3  Hint :  Use  integral  tests.  Note 


lim 

n—>  oo 


l 

x(log  x)P 


dx  = 


lim 

n—too 


15.5  There  is  no  smallest  po  >  1,  so  there  is  no  single  series  ^  l/nPo  with 
which  all  series  ^  l/np  [p  >  1]  can  be  compared. 

15.7  (a)  Proof  Let  e  >  0.  By  the  Cauchy  criterion,  there  exists  N 
such  that  n  >  m  >  N  implies  |  Y^k=m  afc|  <  f  •  I11  particular, 


n  >  N  implies 


e 

OAT+l  +  •  •  •  +  On  <  2' 


So  n  >  N  implies 


(n 


N)an  <  oat+i  +  •  •  •  +  an  <  — . 


If  n  >  2 N,  then  n  <  2 (n  —  N),  so  nan  <  2 (n  —  N)an  <  e.  This 
proves  lim(?rarl)  =  0. 

16.1  (a)  In  other  words,  show 


2  +  7-10  x  +  4- 10  2  +  V 9- 10  J  =  2  +  7- 10  1  +  5- 10  2  =  — . 

4 

3= 3 

The  series  is  a  geometric  series;  see  Example  1  of  §14. 

(b)  2.750 

16.3  Let  A  and  B  denote  the  sums  of  the  series.  By  Exercise  14.5,  we  have 
B  —  A  =  bn  —  an).  Since  bn  —  an  >  0  for  all  n,  and  bn  —  an  >  0 
for  some  n,  we  clearly  have  B  —  A  >  0. 

16.5  (a)  .1250  and  .1249;  (c)  .6;  (e)  .54 

16.7  No. 

16.9  (a)  7„  -  7n+i  =  /"+1  t~l  dt  -  ^  >  0  since  ^  <  t_1  for  all  t  in 
[n,n  +  1). 

(b)  For  any  n,  7„  <  71  =  1.  Also 


(c)  Apply  Theorem  10.2. 

(a)  dom {f+g)  =  dom (fg)  =  (-00, 4],  dom(/o5)  =  [-2,2],  dom^o 
/)  =  (—00,  4], 


17.1 
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(b)  fog(0)  =  2,  gof(0)  =  4,  fog{l)  =  y/3,  50/(1)  =  3,  fog(2)  =  0, 
5  o/(2)  =  2. 

(c)  No! 

(d)  /  o  g[ 3)  is  not,  but  g  o  /( 3)  is. 


17.3  (a)  We  are  given  f(x)  =  cosx  and  g(x)  =  x4  [p  =  4]  are  continu¬ 
ous.  So  go  f  is  continuous  by  Theorem  17.5,  i.e. ,  the  function 
g  o  f(x)  =  cos4  2;  is  continuous.  Obviously  the  function  iden¬ 
tically  1  is  continuous  [if  you  do  not  find  this  obvious,  check 
it].  Hence  1  +  cos4  2  is  continuous  by  Theorem  17.4(i).  Finally 
loge(l  +  cos4  2)  is  continuous  by  Theorem  17.5  since  this  is 
h  o  k(x)  where  k(x)  =  1  +  cos4  x  and  h(x)  =  loge  x. 

(b)  Since  we  are  given  sin  2  and  x2  are  continuous,  Theorem  17.5 
shows  sin2  x  is  continuous.  Similarly,  cos6  x  is  continuous.  Hence 
sin2  x  +  cos6  x  is  continuous  by  Theorem  17.4(i).  Since  sin2  x  + 
cos6  x  >  0  for  all  x  and  since  x 7r  is  given  to  be  continuous  for 
x  >  0,  we  use  Theorem  17.5  again  to  conclude  [sin2  x  +  cos6  2]71’ 
is  continuous. 

(e)  We  are  given  sin  x  and  cos  x  are  continuous  at  each  x  £  R.  So 
Theorem  17.4(iii)  shows  =  tan  x  is  continuous  wherever 
cosx  7^  0,  i.e.,  for  x  /  odd  multiple  of  |. 

17.5  (  a)  Remarks.  An  e-5  proof  can  be  given  based  on  the  identity 


Xm  -  ym  =  (x  -  y)(xm -1  +  Xm~2y  +  •  •  •  +  XV 


Or  the  result  can  be  proved  by  induction  on  m,  as  fol¬ 
lows.  It  is  easy  to  prove  g(x)  =  x  is  continuous  on  R.  If 
f(x)  =  xm  is  continuous  on  R,  then  so  is  (fg)(x)  =  xm+l 
by  Theorem  17.4(h). 

(b)  Just  use  (a)  and  Theorems  17.4(i)  and  17.3. 

17.9  (a)  Discussion.  Let  e  >  0.  We  want  |22  — 4|  <  e  for  \x  —  2|  small,  i.e., 
we  want  \x  —  2|  •  \x  +  2|  <  e  for  \x  —  2|  small.  If  \x  —  2|  <  1,  then 
|x  +  2|  <  5,  so  it  suffices  to  get  \x  —  2|  •  5  <  e.  Set  5  =  min{l,  |}. 

(c)  For  e  >  0,  let  S  =  e  and  observe 


\x  —  0|  <  S  implies 


17.11  If  /  is  continuous  at  20  and  if  (xn)  is  a  monotonic  sequence  in  dom(/) 
converging  to  2q,  then  we  have  lim/(2n)  =  /( 2q)  by  Definition  17.1. 
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Now  assume 

if  (xn)  is  monotonic  in  dom(/)  and  limxn  =  xo,  ,  , 

then  lim/(x„)  =  f(x 0), 

but  /  is  discontinuous  at  xq.  Then  by  Definition  17.1,  there  exists 
a  sequence  (xn)  in  dom(/)  such  that  limx„  =  xq  but  (f(xn))  does 
not  converge  to  f[x o).  Negating  Definition  17.1,  we  see  there  exists 
e  >  0  such  that 

for  each  N  there  is  n  >  N  satisfying  \f(xn)  —  f(x o)|  >  e.  (2) 

It  is  easy  to  use  (2)  to  obtain  a  subsequence  (xnk)  of  (, xn )  such  that 

I  f(xnk)  -  f{x 0)|  >  e  for  all  k.  (3) 

Now  Theorem  11.4  shows  (, xnk )  has  a  monotonic  subsequence  (xnk. ). 
By  (1)  we  have  lirn7_>.00  f(xnk . )  =  /(x o),  but  by  (3)  we  have 
|  f{xnkj )  —  /(x0)|  >  e  for  all  j j  a  contradiction. 

17.13  (a)  Hint:  Let  x  £  K.  Select  a  sequence  (xn)  such  that  limxn  = 
x,  xn  is  rational  for  even  n,  and  xn  is  irrational  for  odd  n. 
Then  /(x„)  is  1  for  even  n  and  0  for  odd  n,  so  {f(xn))  cannot 
converge. 

17.15  We  abbreviate 

(i)  /  is  continuous  at  xo, 

(ii)  lim  f(xn)  =  f(x0)  for  every  sequence  (xn)  in  dom(/)  \  {x0} 
converging  to  xq. 

From  Definition  17.1  it  is  clear  that  (i)  implies  (ii).  Assume  (ii) 
holds  but  (i)  fails.  As  in  the  solution  to  Exercise  17.11,  there  is  a 
sequence  (xn)  in  dom(/)  and  an  e  >  0  such  that  limx„  =  xq  and 
|  f(xn)  —  f(x o)|  >  e  for  all  n.  Obviously  xn  ^  Xq  for  all  n,  i.e.,  (xn) 
is  in  dom(/)  \  {x’o}.  The  existence  of  this  sequence  contradicts  (ii). 
18.3  This  exercise  was  deliberately  poorly  stated,  as  if  /  must  have  a 
maximum  and  minimum  on  [0,  5);  see  the  comments  following  The¬ 
orem  18.1.  The  minimum  of  /  on  [0,  5)  is  1  =  /( 0)  =  /( 3),  but  /  has 
no  maximum  on  [0,  5)  though  sup{/(x)  :  x  £  [0,  5)}  =  21. 

18.5  (a)  Let  h  =  f—g.  Then  h  is  continuous  [why?]  and  h(b)  <  0  <  h(a). 
Now  apply  Theorem  18.2. 

(b)  Use  the  function  g  defined  by  g{x)  =  x  for  x  £  [0, 1]. 

18.7  Hint:  Let  /(x)  =  xefy  /  is  continuous,  /( 0)  =  0  and  /( 1)  =  e. 

18.9  Let  /(x)  =  ao  +  a\X  +  •  •  •  +  anxn  where  an  ^  0  and  n  is  odd.  We 
may  suppose  an  =  1;  otherwise  we  would  work  with  (1  /an)f.  Since 
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/  is  continuous,  Theorem  18.2  shows  it  suffices  to  show  f(x)  <  0 
for  some  x  and  f(x)  >  0  for  some  other  x.  This  is  true  because 
lim^-j.oo  /( x)  =  +oo  and  lim^^-oo  f(x)  =  —  oo  [remember  an  =  1], 
but  we  can  avoid  these  limit  notions  as  follows.  Observe 


f(x)  =  x" 


clq  +  cl\X  +  •  •  •  +  an—\x 


,n—  1 


(1) 


Let  c  =  1  +  |ao|  +  |ai|  H - +  |an_i|.  If  |x|  >  c,  then 


\ao  +  a\x an-ixn  1|  <  (|ao|  +  |ai|  +  - 


•  +  |an_i|)br  1  <  b| 


so  the  number  in  brackets  in  (1)  is  positive.  Now  if  x  >  c,  then 
xn  >  0,  so  f(x)  >  0.  And  if  x  <  —  c,  then  xn  <  0  [why?],  so 
/(+’)  <  0. 

19.1  Hints:  To  decide  (a)  and  (b),  use  Theorem  19.2.  Parts  (c),  (e),  (f) 
and  (g)  can  be  settled  using  Theorem  19.5.  Theorem  19.4  can  also  be 
used  to  decide  (e)  and  (f);  compare  Example  6.  One  needs  to  resort 
to  the  definition  to  handle  (d). 

19.3  (a)  Discussion.  Let  e  >  0.  We  want 


x _ y_ 

x  +  1  y  +  1 

for  \x  —  y\  small,  x,  y  £  [0,  2],  Since  x  +  1  >  1  and  y  +  1  >  1 
for  x,  y  €  [0, 2],  it  suffices  to  get  \x  —  y\  <  e.  So  we  let  S  =  e. 
Formal  Proof  Let  e  >  0  and  let  5  =  c.  Then  x,  y  €  [0,  2]  and 
\x  —  y\  <  5  =  e  imply 


<  e  or 


x-y 


(x  +  l)(y  +  1) 


<  e 


I  f(x)  -  f(y)  |  = 


x-y 


(a: +  l)(t/  +  l) 


<  \x  -  y\  <  e. 


5y—5x 


< 


(b)  Discussion.  Let  e  >  0.  We  want  \g(x)  —  g(y)\  =  i  ( 2x-i)(2V-i ) 
e  for  \x  —  y\  small,  x  >  1,  y  >  1.  For  x,  y  >  1,  we  have  2a:  — 1  >  1 
and  2y  —  1  >  1,  so  it  suffices  to  get  |5 y  —  5a;|  <  e.  So  let  5  =  |. 
You  should  write  out  the  formal  proof. 

19.5  (a)  tana:  is  uniformly  continuous  on  [0,  J]  by  Theorem  19.2. 

(b)  tana:  is  not  uniformly  continuous  on  [0,  J)  by  Exercise  19.4(a), 
since  the  function  is  not  bounded  on  that  set. 

(c)  Let  h  be  as  in  Example  9.  Then  (sinx)h(x)  is  a  continuous 
extension  of  (j)sin2a;  on  (0, 7r] .  Apply  Theorem  19.5. 

(e)  is  not  uniformly  continuous  on  (3,4)  by  Exercise  19.4(a), 
so  it  is  not  uniformly  continuous  on  (3,  oo)  either. 
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(f)  Remark.  It  is  easy  to  give  an  e-8  proof  that  ^-3  is  uniformly 
continuous  on  (4, 00).  It  is  even  easier  to  apply  Theorem  19.6. 

19.7  (a)  We  are  given  /  is  uniformly  continuous  on  [k,  00),  and  /  is 

uniformly  continuous  on  [0,  k  +  1]  by  Theorem  19.2.  Let  e  >  0. 
There  exist  and  82  so  that 

\x~  y\  <  h,  x,y  e  [ft,  00)  imply  \f(x)-f(y)\<e, 

\x-  y\  <  82,  x,y  €  [0,fc+  1]  imply  \f(x)  -  f(y)\  <  e. 

Let  8  =  min{l,  <5i ,  <5^2 }  and  show 

\x-y\  <  8,  x,y  £  [0,oo)  imply  \f(x)  -  f{y)\  <  e. 

19.9  (c)  This  is  tricky,  but  it  turns  out  that  /  is  uniformly  contin¬ 

uous  on  R.  A  simple  modification  of  Exercise  19.7(a)  shows 
it  suffices  to  show  /  is  uniformly  continuous  on  [1, 00)  and 
(—oo,—l].  This  can  be  done  using  Theorem  19.6.  Note  we 
cannot  apply  Theorem  19.6  on  R  because  /  is  not  differentiable 
at  x  =  0;  also  /'  is  not  bounded  near  x  =  0. 

19.11  As  in  the  solution  to  Exercise  19.9(c),  it  suffices  to  show  h  is 
uniformly  continuous  on  [1,  00)  and  (—00,  —1].  Apply  Theorem  19.6. 

20.1  lim^oo  f(x)  =  lim3._^0+  f(x)  =  1;  limx^0-  f(x)  =  lim^-oo 
f[x)  =  -1;  lirnT^o  f(x)  does  NOT  EXIST. 

20.3  limx_>.00  f(x)  =  limx^_00  f(x)  =  0;  limx_>0+  f(x)  =  lim^o- 
f{x)  =  lim  ^o/(x)  =  1. 

20.5  Let  S  =  (0, 00).  Then  f(x)  =  1  for  all  x  €  S.  So  for  any  sequence 
(xn)  in  S  we  have  lim/(xn)  =  1.  It  follows  that  linxc_),cls  f(x)  = 
Hindoos  f(x)  =  1,  i.e.,  limx_).0+  /( x)  =  lim^oo  f(x)  =  1.  Like¬ 
wise  if  S  =  (—oo,0),  then  limx^.0s  f(x)  =  lim x_^_oas  f(x)  =  — 1, 
so  lining-  f(x)  =  lim^^-oo  f(x)  =  —1.  Theorem  20.10  shows 
limx^.o  f{x)  does  not  exist. 

20.7  If  (1 xn )  is  a  sequence  in  (0,oo)  and  limxn  =  +00,  then  lim(l/a;n) 

=  0.  Since  (sin:rn)  is  a  bounded  sequence,  we  conclude  lim(sina;„)/ 
xn  =  0  by  Exercise  8.4.  Hence  Hindoo  f(x)  =  0.  Similarly 

limx_)._00  f[x)  =  0.  The  remaining  assertion  is  limx_>.g  =  1 
which  is  discussed  in  Example  9  of  §19. 

20.9  lim^oo  f(x)  =  -00;  limx_j.0+  f(x)  =  +00;  limx^.0-  f(x)  =  -00; 
lim^-oo  f(x)  =  +00;  limx_>g  f{x)  does  NOT  EXIST. 

20.11  (a)  2a;  (c)  3a2. 
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20.13  First  note  that  if  lim^^aS  f(x)  exists  and  is  finite  and  if  k  £  R,  then 
limx_>.as(k/)(x)  =  k  ■  line^aS  f(x).  This  is  Theorem  20.4(h)  where 
/i  is  the  constant  k  and  fi  =  f  ■ 

(a)  The  remark  above  and  Theorem  20.4  show 

lim  [3 f{x)  +  g{x)2]  =  3  lim  f(x)  +  [lim  g(x)]2  =  3  •  3  +  22  =  13. 

x—*a  x—^a  x—>a 

(c)  As  in  (a),  limx_>.a[3/(:z;)  +  8g(x)]  =  25.  There  exists  an  open 
interval  J  containing  a  such  that  f(x)  >  0  and  g(x)  >  0  for  x  £ 
J\{a}.  Theorem  20.5  applies  with  S  =  J\{a},  3/ +  85  in  place 
of  /  and  with  g(x)  =  yfx  to  give  lim^a  \j2>f{x)  +  8g(x)  = 
V25  =  5. 

20.15  Let  (x„)  be  a  sequence  in  (—00, 2)  such  that  lima:n  =  —00.  We 
contend 

\im(xn  —  2)-3  =  0.  (1) 

We  apply  Exercises  9.10  and  9.11  and  Theorems  9.9  and  9.10  to 
conclude  lim(— xn)  =  +00,  lim(2  —  xn)  =  +00,  lim (2  —  xn)3  =  +00, 
lim (2  —  xn)~3  =  0,  and  hence  (1)  holds. 

Now  consider  a  sequence  (xn)  in  (2,  00)  such  that  lim  xn  =  2.  We 
show 

lim(a;n  —  2)-3  =  +00.  (2) 

Since  \im{xn  —  2)  =  0  and  each  xn  —  2  >  0,  Theorem  9.10  shows 
we  have  lim(a:rl  —  2)_1  =  +00  and  (2)  follows  by  an  application  of 
Theorem  9.9. 

20.17  Suppose  first  that  L  is  finite.  We  use  (1)  in  Corollary  20.8.  Let  e>0. 
There  exist  <5i  >  0  and  £3  >  0  such  that 

a  <  x  <  a  +  8\  implies  L  —  e  <  fi(x)  <  L  +  e 

and 

a  <  x  <  a  +  83  implies  L  —  e  <  fs(x)  <  L  +  e. 

If  8  =  min{<5i ;  £3},  then 

a  <  x  <  a  +  8  implies  L  —  e  <  fi  (x)  <  L  +  e. 

So  by  Corollary  20.8  we  have  lim.,.^0+  /2(x)  =  L. 

Suppose  L  =  +00.  Let  M  >  0.  In  view  of  Discussion  20.9,  there 
exists  8  >  0  such  that 

a  <  x  <  a  +  8  implies  /1  (x)  >  M. 
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Then  clearly 


a  <  x  <  a  +  S  implies  fi  ( x )  >  M, 

and  this  shows  lima,_).a+  fz(x)  =  +oo.  The  case  L  =  — oo  is  similar. 
20.19  Suppose  L 2  =  lim3,.^0s  /( x)  exists  with  S  =  (a,  62)-  Consider  a  se¬ 
quence  (xn)  in  (a,  b\)  with  limit  a.  Then  (xn)  is  a  sequence  in  (a,  62) 
with  limit  a,  so  lim  f(xn)  =  L 2.  This  shows  lmr^aS  f(x)  =  L2  with 
S  =  (a,  61). 

Suppose  L 1  =  lima._>Qs  f(x)  exists  with  S  =  (a,  b±),  and  consider  a 
sequence  (x„)  in  (a,  62)  with  limit  a.  There  exists  N  so  that  n>  N 
implies  xn  <  b\.  Then  (xn)™^  is  a  sequence  in  (a,  61)  with  limit  a. 
Hence  lim/(xn)  =  L\  whether  we  begin  the  sequence  at  n  =  N  or 
n  =  l.  This  shows  lima,_),Qs  f(x)  =  L\  with  S  =  (a,  62)- 
21.1  Let  e  >  0.  For  j  =  1,2,...,  k,  there  exist  Sj  >  0  such  that 

s,t  G  K  and  |s  -  t\  <  Sj  imply  \fj(s)  -  f3(t)\  <  ~^=. 

Let  5  =  min{<5i,62)  •  ■  ■  Then  by  (1)  in  the  proof  of  Propo¬ 
sition  21.2, 

x,tGR  and  |s  —  t\  <  S  imply  d*(y(s),  j(t))  <  e. 

21.3  Hint:  Show  | d(s,  So)  —  d(t,  So)|  <  d(s,  t).  Hence  if  e  >  0,  then 

s,t  €  S  and  d(s,t)  <  e  imply  |/(s)  —  f(t)\  <  e. 

21.5  (b)  By  part  (a),  there  is  an  unbounded  continuous  real-valued  func¬ 
tion  /  on  E.  Show  h  =  is  continuous,  bounded  and  does 
not  assume  its  supremum  1  on  E. 

21.7  (b)  7  is  continuous  at  to  if  for  each  to  £  [a,  6]  and  e  >  0  there  exists 
5  >  0  such  that 

t  £  [a,b]  and  \t  —  io|  <  <5  imply  d*( 7(f),  7(t0))  <  £• 

Note:  If  7  is  continuous  at  each  to  £  [a,  6],  then  7  is  uniformly 
continuous  on  [a,  b]  by  Theorem  21.4. 

21.9  (a)  Use  f{x\,X2)  =  x\,  say. 

(b)  This  is  definitely  not  obvious,  but  there  do  exist  continuous 
mappings  of  [0, 1]  onto  the  unit  square.  Such  functions  must  be 
“wild”  and  are  called  Peano  curves  [after  the  same  Peano  with 
the  axioms];  see  [16,  §5.5]  or  [55,  §6.3]. 
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21.11  If  Q  were  equal  to  n^L1Un,  where  each  Un  is  open,  then  D 
nreQ(R  \  {r})  would  be  an  intersection  of  a  sequence  of  open  sets 
that  is  equal  to  the  empty  set,  contrary  to  Theorem  21.7(a). 

21.13  Suppose  uif(x)  =  0.  Given  e  >  0,  there  is  8  >  0  so  that 

sup{|/(y)  -  f(z) |  :  y,  z  G  {x  -  <5,  x  +  <5)}  <  e. 

Then  |/(a;)  —  f(y)\  <  e  for  all  y  G  (x  —  8,  x  +  8),  i.e.,  \x  ~  y\  <8 
implies  \f(x)  —  f(y) |  <  e.  So  /  is  continuous  at  x.  The  proof  that 
continuity  of  /  at  x  implies  uif(x)  =  0  is  similar. 

22.1  (a)  [0,1]  is  connected  but  [0,1]  U  [2,3]  is  not.  See  Theorem  22.2. 
Alternatively,  apply  the  Intermediate  Value  Theorem  18.2. 

22.3  Assume  E  is  connected  but  E~  is  not.  Then  there  exist  open  sets 
U\  and  U2  that  separate  E~  as  in  Definition  22.1(a).  Show  that  U\ 
and  U2  separate  E ,  which  is  a  contradiction.  Since  E  satisfies  (1)  in 
Definition  22.1(a),  it  suffices  to  show  E  n  U\  7^  0  and  E  D  U2  7^  0. 
In  fact,  if  E  D  U\  =  0,  then  E~  D  (S  \  U\)  would  be  a  closed  set 
containing  E,  and  it  is  smaller  than  E~  since  E~  n  U\  7^  0.  This 
contradicts  the  definition  of  E~  in  Definition  13.8,  so  E  n  U\  7^  0. 
Likewise  E  n  U2  7^  0. 

22.5  (a)  Assume  open  sets  U\  and  U2  separate  E  U  F  as  in  Defini¬ 
tion  22.1(a).  Consider  x  G  E  n  F;  x  belongs  to  one  of  the 
open  sets,  say  x  €  U\.  Select  y  in  (E  U  F)  fl  L^.  Then  y  is  in 
E  or  F,  say  y  G  E.  Since  x  G  E  fl  U\  and  y  G  E  fl  U2,  these 
sets  are  nonempty.  Thus  Ui  and  U2  separate  E,  and  E  is  not 
connected,  a  contradiction. 

(b)  No  such  example  exists  in  R  [why?],  but  many  exist  in  the 
plane. 

22.9  Discussion.  Given  e  >  0,  we  need  <5  >  0  so  that 

s,teR  and  |s  —  t|  <  6  imply  d(F(s),  F(t))  <  e.  (1) 


Now 

d(F{s),  F(t ))  =  sup{| sf(x)  +  (1  -  s)g{x)  -  tf(x)  -  (1  -  t)g(x) \  :  x  &  S} 
=  sup{|s/(x)  -  tf( x)  -  sg(x)  +  tg(x)\  :  x  G  S} 

<  \s  ~  t\  ■  sup{|/(x)|  +  \g(x)\  :  x  G  S}. 

Since  /  and  g  are  fixed,  the  last  supremum  is  a  constant  M.  We  may 
assume  M  >0,  in  which  case  8  =  -A  will  make  (1)  hold. 
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22.11  (a)  Let  (/„)  be  a  convergent  sequence  in  £.  By  Proposition  13.9(b), 
it  suffices  to  show  /  =  lim  /„  is  in  £ .  For  each  x  £  S, 


1/0*01  <  I  f{x)  ~  fn{x)  I  +  \fn(x)\  <  d(f,  fn)  +  1. 

Since  limd(/,  fn)  =  0,  we  have  |/(x)|  <  1. 

(b)  It  suffices  to  show  C(S)  is  path-connected.  So  use 
Exercise  22.9. 

23.1  Intervals  of  convergence:  (a)  (—1, 1);  (c)  [—  1,  |];  (e)  R;  (g)  [—  |,  |). 

23.3  (-^2,  s/2). 

23.5  (a)  Since  \an\  >  1  for  infinitely  many  n,  we  have  sup{|an|1/n  : 

n  >  N}  >  1  for  all  N.  Thus  j3  =  limsup  |arl|1/n  >  1;  hence 

R=  ji  -  1- 

(b)  Select  c  so  that  0  <  c  <  limsup  |a„|.  Then  sup{|ara|  :  n  > 
N}  >  c  for  all  N.  A  subsequence  (anJ  of  (an)  has  the 
property  that  \ank  \  >  c  for  all  k.  Since  \ank\L^nk  >  (c)1/"fc  and 
linifc^oo  c1/nfc  =  1  [by  Theorem  9.7(d)],  Theorem  12.1  shows 
limsup  \dnk\1^nk  >  1.  It  follows  that  /3  =  limsup  \an I1/"  >  1 
[use  Theorem  11.8].  Hence  R  =  ^  <  1. 

23.9  (a)  Obviously  lim/„(0)  =  0.  Consider  0  <  x  <  1  and  let  sn  = 

nxn.  Then  sn+1/sn  =  so  lim  |s„+i/s„|  =  x  <  1. 

Exercise  9.12(a)  shows  0  =  limsra  =  \\\wnxn  =  lim/n(a:). 

24.1  Discussion.  Let  e  >  0.  We  want  \fn(x)  —  0|  <  e  for  all  x  and  for 
large  n.  It  suffices  to  arrange  for  <  e  for  large  n.  So  consider 
n  >  9/e2  =  N. 

24.3  (a)  f(x)  =  1  for  0  <  x  <  1;  /( 1)  =  f(x)  =  0  for  x  >  1.  See 

Exercise  9.13. 

(b)  (fn)  does  not  converge  uniformly  on  [0, 1]  by  Theorem  24.3. 

24.5  (a)  f(x)  =  0  for  x  <  1  and  f(x)  =  1  for  x  >  1.  Note  fn(x )  = 

1/(1  +  n/xn )  and  lim^oo  n/xn  =  0  for  x  >  1  by  Exercise  9.12 
or  9.14. 

(b)  fn  0  uniformly  on  [0,1].  Hint:  Show  \fn(x)\  <  ^  for  x  £ 
[0,1]. 

(c)  Hint:  Use  Theorem  24.3. 

24.7  (a)  Yes.  f(x)  =  x  for  x  <  1  and  f(l)  =  0. 

(b)  No,  by  Theorem  24.3  again. 

24.9  (a)  f(x)  =  0  for  x  £  [0,1].  For  x  <  1,  lim^oo  nxn  =  0  as  in 

Exercise  23.9(a). 

(b)  Use  calculus  to  show  fn  takes  its  maximum  at  ^//y.  Thus 
sup{ | /„(#)!  :  x  £  [0,1]}  =  fn(^f)  =  (^r)”+1.  As  in  Exam- 
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pie  8,  it  turns  out  lim/n(;/py)  =  1/e.  So  Remark  24.4  shows 
ifn)  does  not  converge  uniformly  to  0. 

(c)  Jo  fn(x)  dx  =  (n+1)"(n+2)  ->•  0  =  f(x)  dx. 

24.15  (a)  /( 0)  =  0  and  f(x)  =  1  for  x  >  0.  (b)  No.  (c)  Yes. 

24.17  Hint:  Use  \fn(xn)  ~  f(x)\  <  \ fn{xn)  -  f{xn) |  +  | f(xn)  -  f{x)\. 

25.3  (a)  Since  fn(x)  =  (1  +  (cosx)/n)/(2  +  (sin2  x)/n),  we  have  /„  — >  \ 
pointwise.  To  obtain  uniform  convergence,  show 


,  ,  .  1 

2  cos  x  —  sin2  x 

fn(x)  -  g 

— 

2(2 n  +  sin2  x) 

for  all  real  numbers  x  and  all  n  >  ~r 
(b)  fj  t;  dx  =  |,  by  Theorem  25.2. 

25.5  Since  fn—>f  uniformly  on  S,  there  exists  N  G  N  such  that  n  >  N 
implies  | fn{x)  —  f(x) |  <  1  for  all  x  G  S.  In  particular,  we  have 
|/at+i(x)  —  f(x)\  <  1  for  x  €  S.  If  M  bounds  |/at+i|  on  S  [i.e. ,  if 
|/at+i(x)|  <  M  for  x  e  5],  then  M  +  1  bounds  |/|  on  S  [why?]. 

25.7  Let  gn{x)  =  n~2  cosnx.  Then  we  have  \gn{x)\  <  n-2  for  x  £  R  and 
JS  n~'2  <  oo.  So  JS  9n  converges  uniformly  on  R  by  the  Weierstrass 
M-Test  25.7.  The  limit  function  is  continuous  by  Theorem  25.5. 

25.9  (a)  The  series  converges  pointwise  to  jd—  0n  (—1, 1)  by  (2)  of  Ex¬ 
ample  1  in  §14.  The  series  converges  uniformly  on  [—a,  a]  by  the 
Weierstrass  M-Test  since  \xn\  <  an  for  x  G  [—a,  a]  and  since 
an  <  oo. 

(b)  One  can  show  directly  that  the  sequence  of  partial  sums 
sn(x)  =  o  xk  =  (1  —  xn+1)/(l  —  x)  does  not  converge  uni¬ 
formly  on  (—1, 1).  It  is  easier  to  observe  the  partial  sums  sn  are 
each  bounded  on  (—1, 1),  and  hence  if  (sn)  converges  uniformly, 
then  the  limit  function  is  bounded  by  Exercise  25.5.  But 
is  not  bounded  on  (—1,1). 

25.11  (b)  Hint:  Apply  the  Weierstrass  M-Test  to  J2hn,  where  hn(x)  = 
(f  )n9n(x). 

25.13  The  series  SZ  9k  and  ]>/  hk  are  uniformly  Cauchy  on  S  and  it  suffices 
to  show  SZidk  +  hk)  is  also;  see  Theorem  25.6.  Let  e  >  0.  There  exist 
N\  and  N2  such  that 


n  >  to  >  N\  implies 


n  >  m  >  N2  implies 


n 

9k{x) 

k=m 

n 

hk ^ 

k=m 


e 


<  2 


for  x  G  S', 


for  x  G  S. 


(1) 

(2) 


388  Selected  Hints  and  Answers 


Then 

n  >  m  >  max{Ai,  W}  implies 


( 9k  +  hk)(x] 


<  e  for  x  £  S. 


25.15  (a)  Note  fn{x)  >  0  for  all  x  and  n.  Assume  (/„)  does  not  converge 
to  0  uniformly  on  [a,  b\.  Then  there  exists  e  >  0  such  that 


for  each  N  there  exists  n  >  N  and  x  £  [a,  b] 
such  that  fn(x)  >  e. 


(1) 


We  claim 


for  each  n  £  N  there  is  xn  £  [a,  b]  where  fn(xn )  >  £•  (2) 

If  not,  there  is  no  £  N  such  that  fno( x)  <  e  for  all  x  £  [a,  6]. 
Since  {fn(x))  is  decreasing  for  each  x,  we  conclude  fn(x)  <  e 
for  all  x  £  [a,b]  and  n  >  no-  This  clearly  contradicts  (1).  We 
have  now  established  the  hint. 

Now  by  the  Bolzano- Weierstrass  theorem,  the  sequence  (xn) 
given  by  (2)  has  a  convergent  subsequence  ( xnk ):  xnk  — >  Xo- 
Since  lim/„(xo)  =  0,  there  exists  m  such  that  fm(x 0)  <  e. 
Since  xnk  — >  xo  and  fm  is  continuous  at  xo,  we  have 
limfc-j.oo  fm{xnk )  =  fm{x o)  <  £.  So  there  exists  K  such  that 

k  >  K  implies  fm{xnk )  <  £■ 

If  k  >  max{AT,  m},  then  rife  >  k  >  to,  so 

fnk(xnk)  S;  fm(Xnk)  <  e- 


But  fn{xn)  >  e  for  all  n,  so  we  have  a  contradiction. 

(b)  Hint :  Show  part  (a)  applies  to  the  sequence  gn  where  gn  = 

f~fn- 

26.3  (a)  Let  f{x)  =  Y^=  ira"  =  x/{\  —  x)2  for  \x\  <  1.  Then  by 
Theorem  26.5 


E^"_1  =  /'w 

n=  1 


d  r  x 

dx  (1  —  x)2 


(l  +  x)(l-x)  3; 


therefore  n2xn  =  (x  +  x2)(l  —  x)~3. 

(b)  6  and  |. 

26.5  Hint:  Apply  Theorem  26.5. 

26.7  No!  The  power  series  would  be  differentiable  at  each  x  £  R,  but 
f(x)  =  |x|  is  not  differentiable  at  x  =  0. 
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27.1  Let  (f>  be  as  in  the  hint.  By  Theorem  27.4,  there  is  a  sequence  (qn) 
of  polynomials  such  that  qn  —>  f  °  <j>  uniformly  on  [0,1].  Note  <j)  is 
one-to-one  and  4>~1(y)  =  Let  pn  =  qn  o  3_1.  Then  each  pn  is  a 
polynomial  and  pn  — >  f  uniformly  on  [a,  b\. 

27.3  (a)  Assume  a  polynomial  p  satisfies  \p(x)  —  sinx|  <  1  for  all  x  £  M. 

Clearly  p  cannot  be  a  constant  function.  But  if  p  is  nonconstant, 
then  p  is  unbounded  on  M  and  the  same  is  true  for  p[x)  —  sin  a:, 
a  contradiction. 

(b)  Assume  \ex  —  ak%k\  <  1  for  all  ieK.  For  i>0we  have 

n— 1  1  n— 1 

ex  -  ^2  akxk  -  —\xU  ~  X!  \ak\xk 

k= 0  '  k= 0 


and  for  large  x  the  right  side  will  exceed  1. 

27.5  (a)  Bnf(x)  =  x  for  all  n.  Use  (2)  in  Lemma  27.2. 

(b)  Bnf{x)  =  x2  +  L#(l  —  x).  Use  (4)  in  Lemma  27.2. 

28.1  (a)  {0};  (b)  {0};  (c)  {mr  :  n  €  Z};  (d)  {0,1};  (e)  {-1,1};  (f) 
{2}- 

28.3  (b)  Since  a;  —  a  =  (x1/3  —  a1/3)(a;2/3  +  a1/3^1/3  +  a2/3), 

/'(a)  =  lim  f^+a^^+a2/3)-1  =  (3a2/3)"1  =  X"2/3 

x—>a  3 

for  a^O. 

(c)  /  is  not  differentiable  at  x  =  0  since  the  limit  linx^o  x1,/3/x 
does  not  exist  as  a  real  number.  The  limit  does  exist  and  equals 
+oo,  which  reflects  the  geometric  fact  that  the  graph  of  /  has 
a  vertical  tangent  at  (0,  0). 

28.5  (c)  Let 


h(x) 


0)) 

/O)  -  /( 0) 


According  to  Definition  20.3(a),  for  Lim^o  h(x)  to  be  mean¬ 
ingful,  h  needs  to  be  defined  on  J\  {0}  for  some  open  interval 
J  containing  0.  But  the  calculation  in  (b)  shows  h  is  undefined 
at  (7 m)-1  for  n  =  ±1,  ±2, . . .. 

28.7  (d)  /'  is  continuous  on  M,  but  f  is  not  differentiable  at  x  =  0. 
28.9  (b)  f(x)  =  x4  +  13x  and  g(y)  =  y7 .  Then 


h\x)  =  g'(f(x ))  •  f'(x)  =  7(x4  +  13x)6  •  (4x3  +  13). 


28.11  With  the  stated  hypotheses,  h  o  g  o  f  is  differentiable  at  a  and  (h  o 
g  o  f)'{a)  =  h'{g  o  /(a))  •  g'(f{a))  ■  f'{a).  Proof  By  28.4,  g  o  /  is 
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differentiable  at  a  and  (g  o  f)'(a)  =  g'(f(a))  ■  Again  by  28.4, 

(ho  (go  f))’(a)  =  h'((g  o  f)(a))  ■  ( g  o 

28.13  There  exist  positive  numbers  <5i  and  e  so  that  /  is  defined  on  the 
interval  (a  —  <5i ,  a  +  <5i)  and  g  is  defined  on  (/(a)  —  e,  /(a)  +  e).  By 
Theorem  17.2,  there  exists  <52  >  0  so  that 


t  £  dom(/)  and  |a:  —  a|  <  A2  imply  \f(x)  —  f(a)\<e. 


If  \x  —  a\  <  minjAi, <52},  then  x  £  dom (/)  and  \f(x)  —  f(a) \  <  e,  so 
f(x)  £  dom(g),  i.e.,  x  £  dom(g  o  /). 

29.1  (a)  x=\ 

(c)  If  f(x)  =  |a:|,  then  f'(x)  =  ±1  except  at  0.  So  no  x  satisfies  the 
equation  f'(x)  =  =  3-  Missing  hypothesis:  /  is  not 

differentiable  on  (—1,2),  since  /  is  not  differentiable  at  x  =  0. 
(e)  x  =  V3 

29.3  (a)  Apply  Mean  Value  Theorem  to  [0,2]. 

(b)  By  the  Mean  Value  Theorem,  f(y)  =  0  for  some  y  £  (1,2). 
In  view  of  this  and  part  (a),  Theorem  29.8  shows  f  takes  all 
values  between  0  and 

29.5  For  any  a  G  R  we  have  |  |  <  |x— a  |.  It  follows  easily  that  f(a) 

exists  and  equals  0  for  all  a  £  R.  So  /  is  constant  by  Corollary  29.4. 

29.7  (a)  Applying  29.4  to  /',  we  find  f(x)  =  a  for  some  constant  a.  If 
g(x)  =  f(x)  —  ax,  then  g'( x)  =  0  for  x  £  I,  so  by  29.4  there  is 
a  constant  b  such  that  g(x)  =  b  for  x  £  /. 

29.9  Hint:  Let  f(x)  =  ex  —  ex  for  ieR.  Use  f  to  show  /  is  increasing 
on  [l,oo)  and  decreasing  on  (—00, 1],  Hence  /  takes  its  minimum  at 
x  =  1. 

29.13  Let  h(x)  =  g(x)  —  f(x)  and  show  h(x)  >  0  for  x  >  0. 

29.15  As  in  Example  2,  let  g(x)  =  xl/n .  Since  dom(gr)  =  [0, 00)  if  n  is  even 
and  dom(g)  =  R  if  n  is  odd,  we  have  dom(gr)  =  dom(/i)  U  {0}.  Also 
h  =  gm.  Use  the  Chain  Rule  to  calculate  h’(x). 

29.17  Suppose  f(a)  =  g(a).  Then 


h(x)  —  h(a ) 
hm  - 

x—>a+  X  —  CL 


g'(a)  and 


h(x)  —  h(a ) 
hm  - 

x—>a~  X  —  CL 


/'(«)•  (i) 


If  also  f(a)  =  g’(a),  then  Theorem  20.10  shows  h'(a)  exists  and,  in 
fact,  h'(a )  =  f'(a)  =  g' (a). 

Now  suppose  h  is  differentiable  at  a.  Then  h  is  continuous  at  a  and 
so  /(a)  =  lim.^-  f(x)  =  limx^.a-  h(x)  =  h(a )  =  g(a).  Hence  (1) 
holds.  But  the  limits  in  (1)  both  equal  h'(a),  so  f'(a )  =  g'(a). 


Selected  Hints  and  Answers  391 


30.1  (a)  2;  (b)  ±;  (c)  0;  (d)  1.  Sometimes  L’Hospital’s  rule  can  be 

avoided.  For  example,  for  (d)  note  that 

y/1  +  x  —  \Jl  —  x  2 

X  \/l  -(-  ~x  T  \/  1  —  ~x 

30.3  (a)  0;  (b)  1;  (c)  +oo  (d)  —  |. 

30.5  (a)  e2;  (b)  e2;  (c)  e. 

31.1  Differentiate  the  power  series  for  sinx  term-by-term  and  cite 
Theorem  26.5. 

31.3  The  derivatives  do  not  have  a  common  bound  on  any  interval 
containing  1. 

31.5  (a)  g(x)  =  f{x2)  for  x  £  R.  where  /  is  as  in  Example  3.  Use  in¬ 

duction  to  prove  there  exist  polynomials  pkn ,  1  <  k  <  n,  so 

that 

n 

g(n\x)  f('k){x2)pkn{x)  for  xeK,n>l. 

fc= i 

31.9  Use  xn  =  xn-i  —  Xn1+sin°a!:Cni')1)  ■  To  six  places,  the  answer  is 
0.739085.  As  always,  use  radians. 

31.11  For  some  C  >  0,  we  have  \  f'(x)\  <  C  for  x  in  (a,  b).  Then  \  f{xn-\)\  < 
\xn  —  xn-\  \  ■  C  for  all  n.  Let  n  —>  oo. 

32.1  Use  the  partition  P  in  Example  1  to  calculate  U{f1P)  =  b^n2^  + 
l)2/(4n4)  and  L(f1P)  =  bA(n—  l)2n2/(4n4).  Conclude  [/(/)  =  &4/4 
and  L{f)  =  64/4. 

32.3  (a)  The  upper  sums  are  the  same  as  in  Example  1,  so  U(g)  =  b3/ 3. 

Show  L(g)  =  0. 

(b)  No. 

32.5  S  is  all  the  numbers  L(/,  P),  and  T  is  all  U(f1P). 

32.7  Assume  f{x)  =  0  for  all  x  £  [a,b].  A  simple  induction  shows  we  may 
assume  g(x)  =  0  except  at  one  point  u  £  [a,  6].  Clearly  all  lower  sums 
L(g,P)  =  0,  so  L{g)  =  0.  Since  u  belongs  to  at  most  two  intervals 
of  any  partition  P,  we  have 

U(g,P)  <  2\g(u)\m&x[tk  -  tk- 1]. 

k 

Infer  U (g)  =  0;  hence  f*g  =  0  =  J *  /. 

33.1  If  /  is  decreasing  on  [a,  6],  then  —  /  is  increasing  on  [a,  6],  so  —  /  is 
integrable  as  proved  in  Theorem  33.1.  Now  apply  Theorem  33.3  with 
c  =  — 1. 

33.3  (b)  4A  +  6B 
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33.7  (a)  For  any  set  S  C  [a,  b]  and  xq,  yo  S  S,  we  have 

/0 o)2  -  /(yo)2  <  |/(3=o)  +  f{y0) I  ■  | /(so)  -  /(yo)| 

<  2B\f(xo)  -  f(yo)\  <  2 S)  -  m(f,  S)]. 


It  follows  that  M(/2,  S)  -  m(f2,S)  <  2B[M(f,  S )  -  m(f,  S)]. 
Use  this  to  show  U(f2,  P)  -  L(/2,  P)  <  2P[P(/,  P)  -  L(f,  P)  ]. 
(b)  Use  Theorem  32.5  and  part  (a). 

33.9  Select  m  €  N  so  that  |  f(x)  —  fm{x) \  <  2(b-a)  ^or  x  e  ^]-  Then 
for  any  partition  P 

-,-<L(f-fm,P)<U(f-fm,P)< 


Select  a  partition  P0  so  that  U(fm,Po)  ~  L(fm,Po)  <  f .  Since  /  = 
(f  —  fm)  +  fm,  we  can  use  inequalities  from  the  proof  of  Theorem  33.3 
to  conclude  U(f,Po)  —  L(f,P0)  <  e.  Now  Theorem  32.5  shows  / 
is  integrable.  To  complete  the  exercise,  proceed  as  in  the  proof  of 
Theorem  25.2. 

33.11  (a)  and  (b):  Show  /  is  neither  continuous  nor  monotonic  on  any 
interval  containing  0. 

(c)  Let  e  >  0.  Since  /  is  piecewise  continuous  on  [|,  1],  there  is  a 
partition  Pi  of  [|,  1]  such  that  U(f,P±)  —  L{f,P\)  <  |.  Like¬ 
wise  there  is  a  partition  P2  of  [—  1,—  |]  such  that  U(f,  P2)  — 
L(f,  P2)  <  |.  Let  P  =  Pi  U  P2,  a  partition  of  [— 1, 1].  Since 


)  -  m  (/, 


)}-{§-(-§)} 


we  conclude  U(f,P)  —  L(f,P)  <  e.  Now  Theorem  32.5  shows 
/  is  integrable. 

33.13  Apply  Theorem  33.9  to  /  —  g. 

34.3  (a)  F(x)  =  0  for  x  <  0;  F(x)  =  x2/2  for  0  <  x  <  1;  F(x)  =  4x  —  | 

for  x  >  1. 

(c)  F  is  differentiable  except  possibly  at  x  =  1  by  Theorem  34.3. 
To  show  F  is  not  differentiable  at  x  =  1,  use  Exercise  29.17. 

34.5  F'(x)  =  f(x-l). 

34.9  Use  a  =  0,  b  =  |  and  g(x)  =  since. 

35.3  (a)  21;  (b)  14;  (c)  0. 

35.5  (a)  Every  upper  sum  is  F(b)  —  F(a)  and  every  lower  sum  is  0.  Hence 

UF(f)  =  F(b)  -  F(a)  +  0  =  LF(f). 

35.7  (a)  Imitate  solution  to  Exercise  33.7. 

(b)  and  (c):  Use  hints  in  Exercise  33.8. 
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35.9  (a)  Let  m  and  M  be  the  [assumed]  minimum  and  maximum  of  / 
on  [a,  b ].  Then  J ^  m  dF  <  J ^  f  dF  <  J ^  M  dF  or  m  <  [ F{b )  — 
F(a)]-1  fb  fdF  <  M.  Apply  Theorem  18.2. 

(b)  Consider  /  and  g  as  in  Exercise  33.14,  and  let  F  be  as  in 
Exercise  35.8.  By  part  (a),  for  some  x  G  [a,  6]  we  have 


/  f(t)g{t)dt=[fdF  =  f(x)[F(b)-F(a)]  =  f(x)[  g(t)dt. 

J  a  J  a  J  a 


35.11  Let  e  >  0  and  select  a  partition 


P  =  {a  =  to  <  ti  <■■■<  tn  =  b} 
satisfying  UF(f ,  P)  -  LF(f,  P)  <  e.  Let  uk  =  (j)~l{tk )  and 


Q  =  {c  =  ito  <  u\  <  ■  ■  ■  <  un  —  d}. 

Show  UG{9lQ)  =  UF(f,P)  and  LG(g,Q)  =  LF(f,P).  Then 
Ug{9iQ)  —  Lg{9iQ)  <  e,  so  g  is  G-integrable.  The  equality  of  the 
integrals  follows  easily. 

36.1  Hint :  If  B  bounds  |/|,  then 


f(x)  dx  —  f(x)  dx 


<  B(b  —  d). 


36.3  (b)  Use  part  (a)  and  Examples  1  and  2. 

36.7  (a)  It  suffices  to  show  e~x 2  dx  <  oo.  But  e~x 2  <  e~x  for  x  >  1 
and  e~x  dx  = 

(b)  The  double  integral  equals  ]/3°  e~x  dx}2,  and  it  also  equals 


poo  p2ir  poo 

/  /  e~r  r  d8  dr  =  2tt  /  e~r  r  dr  =  n. 

Jo  Jo  Jo 

36.9  (a)  Hint:  Use  Theorem  35.13. 

(b)  1;  (c)  +oo;  (d)  (e)  0. 

36.13  Claim:  If  /  is  continuous  on  R  and  \  f\  dF  <  oo,  then  /  is  F- 

integrable.  Proof  Since  0  <  /  +  [/[,  the  integral  +  \f\\dF 

exists,  and  since  /  +  |/|  <  2|/|,  this  integral  is  finite,  i.e. ,  /  +  |/| 
is  F-integrable.  Since  — 1/|  is  F-integrable,  Exercise  36.10  shows  the 
sum  of  /  +  |/|  and  — 1/|  is  F-integrable. 

36.15  (a)  For  example,  let  fn{x)  =  -  for  x  G  [0,  n]  and  fn(x)  =  0 
elsewhere. 

(b)  Outline  of  Proof  First,  /  is  F-integrable  on  each  [a,  b]  by 
Exercise  35.6.  An  elaboration  of  Exercise  25.5  shows  there  is 
a  common  bound  B  for  |/|  and  all  |/n|.  Consider  any  b  >  0 
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such  that  1  —  F(b)  <  There  exists  a  number  N  so  that 
|  /0b  /  dF  —  /0b  fn  dF\  <  |  for  n  >  N.  Then 


n  >  N  implies 


<  e. 


(1) 


In  particular,  m,n  >  N  implies  |  /()°°  fn  dF  —  /Q°°  fm  dF |  <  2e, 
so  (/0°°  fn  dF)  n6N  is  a  Cauchy  sequence  with  a  finite  limit  L. 
From  (1)  it  follows  that 


1  —  F{b)  <  —  implies 
2  B 


fdF-L 


<  e, 


so  lim^oo  Jq  f  dF  =  L.  Hence  /0°°  /  dF  exists,  is  finite, 
and  equals  lim„_!.00  JQ°°  fn  dF.  A  similar  argument  handles 

f-oofdF- 

37.1  Hint : 


fyz  1 

r  i  r 

/  -dt- 

i  t 

Ji  t  Jy 

37.7  (a)  B(x)  =  E{xL(b)):  so  by  the  Chain  Rule,  we  have  B'{x )  = 
E{xL{b))  •  L{b)  =  L{b)bx  =  (loge  b)bx . 

37.9  (a)  loge  y  =  L{y)  =  f”  \  dt  <  y  -  1  <  y. 

38.3  Apply  the  Fundamental  Theorem  of  Calculus  34.3  to  a  continuous 
nowhere-differentiable  function  /. 


A  Guide  to  the  References 

There  are  many  books  with  goals  similar  to  ours,  including:  Bran- 
nan  [12],  Clark  [16],  and  Pedrick  [51].  Zorn  [73]  is  a  gentle,  well 
written  introduction  with  a  strong  first  chapter  on  “numbers,  sets 
and  proofs.”  Lay  [41]  also  starts  with  sections  on  logic  and  proofs, 
and  provides  good  answers.  Abbott  [1]  appears  to  be  a  fine  book, 
though  lots  of  the  text  is  left  to  the  exercises.  Bauldry  [3]  is  a  nice 
book  designed  for  a  last  course  in  real  analysis  for  those  intending 
to  go  into  teaching.  Morgan  [47]  gives  a  concise  introduction  to  the 
key  concepts. 

Beardon  [6]  gives  a  coherent  treatment  of  limits  by  defining  the 
notion  just  once,  in  terms  of  directed  sets.  Bressoud  [13]  is  a  wonder- 
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ful  book  that  introduces  analysis  through  its  history.  Gardiner  [23] 
is  a  more  challenging  book,  though  the  subject  is  at  the  same  level; 
there  is  a  lot  about  numbers  and  there  is  a  chapter  on  geometry. 
Hijab  [32]  is  another  interesting,  idiosyncratic  and  challenging  book. 
Note  many  of  these  books  do  not  provide  answers  to  some  of  the 
exercises,  though  [32]  provides  answers  to  all  of  the  exercises. 

Rotman  [61]  is  a  very  nice  book  that  serves  as  an  intermediate 
course  between  the  standard  calculus  sequence  and  the  first  course  in 
both  abstract  algebra  and  real  analysis.  I  always  shared  Rotman’s 
doubts  about  inflicting  logic  on  undergraduates,  until  I  saw  Wolf’s 
wonderful  book  [70]  that  introduces  logic  as  a  mathematical  tool  in 
an  interesting  way. 

More  encyclopedic  real  analysis  books  that  are  presented  at  the 
same  level  with  great  detail  and  numerous  examples  are:  Lewin  and 
Lewin  [43],  Mattuck  [46]  and  Reed  [56].  I  find  Mattuck’s  book  [46] 
very  thoughtfully  written;  he  shares  many  of  his  insights  (acquired 
over  many  years)  with  the  reader. 

There  are  several  superb  texts  at  a  more  sophisticated  level: 
Beals  [4],  Bear  [5],  Hoffman  [33],  Johnsonbaugh  and  Pfaffen- 
berger  [34],  Protter  and  Morrey  [53],  Rudin  [62]  and  Stromberg  [65]. 
Any  of  these  books  can  be  used  to  obtain  a  really  thorough 
understanding  of  analysis  and  to  prepare  for  various  advanced 
graduate-level  topics  in  analysis.  The  possible  directions  for  study 
after  this  are  too  numerous  to  enumerate  here.  However,  a  reader 
who  has  no  specific  needs  or  goals  but  who  would  like  an  introduc¬ 
tion  to  several  important  ideas  in  several  branches  of  mathematics 
would  enjoy  and  profit  from  Garding  [24], 
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N  [positive  integers],  1 
Q  [rational  numbers],  6 
R  [real  numbers],  14 
Z  [all  integers],  6 
e,  37,344 
Rfc,  84 

Bnf  [Bernstein  polynomial],  218 

C(S),  184 

C°°((a,/?)),  352 

d  [a  metric],  84 

dist(a,  b),  17 

dom(/)  [domain],  123 

F-mesh(P),  320 

JF(f,P),UF(f,P),LF(f,P),  300 
Ju  [jump  function  at  u],  301 
lima,_>Qs  f(x),  153 
lirn^a  f(x),  limMa+  f(x), 

lim^-s-oo  f(x),  etc.,  154 
limsn,  sn  — >  s,  35, 51 
limsupSn,  liminfs„,  60,78 
M(f,  S),  m(f,  S),  270 
max  S',  min  S,  20 


max(/,  g),  min(/,  gr),  128 
mesh(P),  275 
n!  [factorial],  6 
(^)  [binomial  coefficients],  6 
Rn{x)  [remainder],  250 
sgn(x)  [signum  function],  132 
sup  S,  inf  S,  22,  29 
U(f),L(f),  270 
t/(/,P),P(/,P),  270 
UF(f),  LF(f),  301 
E°,  87 
E~,  88,171 

/'  [derivative  of  /],  224 
/  [extension  of  /],  146 
/_1  [inverse  function],  137 

f  +  gjgj/gj  °  g,  128 
F(t-),F(t+),  299 
fn—>f  pointwise,  193 
fn~>  f  uniformly,  194 
/:S— >  S*,  164 
sn  — i  s,  35 

(snk)  [subsequence],  66 
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°n  [summation] ,  95 

faf  =  faf(X)dX’  2™,  331 
JbafdF  =  Jbaf(x)dF(X),  301 

fZo  f'dF;  334 


[a,  b],  (a,  b),  [a,  6),  (a,  6],  20 
[a,  oo),  (a,  oo),  (— oo,  6],  etc.,  28 
+oo,  —  oo,  28 
0  [empty  set],  366 
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Abel’s  theorem,  212 
absolute  value,  17 
absolutely  convergent  series,  96 
algebraic  number,  8 
alternating  series  theorem,  108 
Archimedean  property,  25 
associative  laws,  14 


Baire  Category  Theorem,  172, 173 
basic  examples,  limits,  48 
basis  for  induction,  3 
Bernstein  polynomials,  218 
binomial  series  theorem,  255 
binomial  theorem,  6 
Bolzano- Weierstrass  theorem,  72 
for  Rfc,  86 

boundary  of  a  set,  88 
bounded  function,  133 
bounded  sequence,  45 
bounded  set,  21 
in  Rfc,  86 

in  a  metric  space,  94 


Cantor  set,  89 
Cauchy  criterion 

for  integrals,  274, 275 
for  series,  97 

for  series  of  functions,  205 
Cauchy  principal  value,  333 
Cauchy  sequence,  62 
in  a  metric  space,  85 
uniformly,  202 

Cauchy’s  form  of  the  remainder  of 
a  Taylor  series,  254 
cell  in  Rfc,  91 
chain  rule,  227 
change  of  variable,  295, 330 
closed  interval,  20,  28 
closed  set,  75 

in  a  metric  space,  88, 171 
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complete  metric  space,  85 
completeness  axiom,  23 
composition  of  functions,  128 
connected  set,  179 
continuous  function,  124, 164 
piecewise,  286 
uniformly,  140, 164 
convergence,  interval  of,  189 
convergence,  radius  of,  188 
convergent  improper  integral,  332 
convergent  sequence,  35 
in  a  metric  space,  85 
convergent  series,  95 
converges  absolutely,  96 
converges  pointwise,  193 
converges  uniformly,  194 
convex  set,  182 
cover,  90 
curve,  165 

Darboux  integrals,  270 
Darboux  sums,  270 
Darboux-Stieljtes  sums,  300 
Darboux-Stieltjes  integrable 
function,  301 

Darboux-Stieltjes  integrals,  301 
decimal  expansions,  58,109,  114 
decreasing  function,  108,  235 
decreasing  sequence,  56 
Dedekind  cuts,  31 
definition  by  induction,  69 
deMorgan’s  laws,  93 
dense  set  in  a  metric  space,  171 
denseness  of  Q,  25 
density  function,  335 
derivative,  223 
diameter  of  a  fc-cell,  91 
differentiable  function,  223 
Dini’s  theorem,  208 
disconnected  set,  178 
discontinuous  function,  126 
distance  between  real  numbers,  17 


distance  function,  84 
distribution  function,  334 
distributive  law,  14 
divergent  improper  integral,  332 
divergent  sequence,  35 
divergent  series,  95 
diverges  to  +oo  or  — oo,  51,  95 
divides,  9 

division  algorithm,  117 
domain  of  a  function,  123 
dominated  convergence  theorem, 
288 


e,  37, 344 
is  irrational,  117 
equivalent  properties,  27 
Euclidean  fc-space,  84 
Euler’s  constant,  120 
exponentials,  a  definition,  345 
extension  of  a  function,  146 


factor,  9 
factorial,  6 
field,  14 
ordered,  14 

F-integrable  function,  301,334 
fixed  point  of  a  function,  135 
fixed  point  theorem,  240 
floor  function,  112 
F-mesh  of  a  partition,  320 
formal  proof,  39 
function,  123 

fundamental  theorem  of  calculus, 
292,  294 


generalized  mean  value  theorem, 
241 

geometric  series,  96 
greatest  lower  bound,  22 
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half-open  interval,  20 
Heine-Borel  theorem,  90 
helix,  166 

improper  integral,  331 
converges,  332 
increasing  function,  235 
increasing  sequence,  56 
indeterminate  forms,  241 
induction  step,  3 
induction,  mathematical,  2 
inductive  definition,  69 
inhmum  of  a  set,  22 
infinite  series,  95 
infinitely  differentiable  function, 
256 

infinity  +00,  —00,  28 
integers,  6 

integrable  function,  270,277,  291 
on  M,  334 

integral  tests  for  series,  107 
integration  by  parts,  293,316 
integration  by  substitution,  295 
interior  of  a  set,  87, 171 
intermediate  value  property, 
134,183 

intermediate  value  theorem,  134 
for  derivatives,  236 
for  integrals,  287, 290 
interval  of  convergence,  189 
intervals,  20,  28 
inverse  function 
continuity  of,  137 
derivative  of,  237 
irrational  numbers,  27 
7 r,  118 
e,  117 

jump  of  a  function,  299 
/c-cell,  91 

fc-dimensional  Euclidean  space,  84 


L ’Hospital’s  rule,  242 
least  upper  bound,  22 
left-hand  limit,  154 
Leibniz’  rule,  232 
liminf,  limsup,  60,78 
limit  of  a  function,  153 
limit  of  a  sequence,  35,  51 
limit  theorems 
for  functions,  156 
for  sequences,  46, 52 
for  series,  104 
limits  of  basic  examples,  48 
logarithms,  a  definition,  345 
long  division,  110 
lower  bound  of  a  set,  21 
lower  Darboux  integral,  270 
lower  Darboux  sum,  270 
lower  Darboux-Stieltjes  integral, 
301 

lower  Darboux-Stieltjes  sum,  300 
maps,  177 

mathematical  induction,  2 
maximum  of  a  set,  20 
mean  value  theorem,  233 
generalized,  241 
mesh  of  a  partition,  275 
metric,  metric  space,  84 
minimum  of  a  set,  20 
monic  polynomial,  10 
monotone  convergence  theorem, 
288 

monotone  or  monotonic  sequence, 
56 

monotonic  function,  280 
piecewise,  286 

natural  domain  of  a  function,  123 
Newton’s  method,  12,  259 
nondegenerate  interval,  175 
normal  density,  335 
normal  distribution,  335 
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nowhere  dense 

subset  of  a  metric  space,  171 
nowhere-differentiable  continuous 
function,  348,  350,361 

open  cover,  89 
open  interval,  20,29 
open  set  in  a  metric  space,  87 
order  properties,  14 
ordered  field,  14 
oscillation  function,  175 

partial  sums,  95 
partition  of  [a,  6],  270 
parts,  integration  by,  293,316 
path,  165, 180 
path-connected  set,  180 
Peano  Axioms,  2 
perfect  set,  174 
7 r  is  irrational,  118 
piecewise  continuous  function,  286 
piecewise  linear  function,  357 
piecewise  monotonic  function,  286 
pointwise  convergence,  193 
polynomial  approximation 
theorem,  218,  220 
polynomial  function,  131 
positive  integers,  1 
postage-stamp  function,  133 
power  series,  187 
prime  number,  26 
product  rule  for  derivatives,  226 
proof,  formal,  39 


quadratic  convergence,  265 
quotient  rule  for  derivatives,  226 


radius  of  convergence,  188 
ratio  test,  99 
rational  function,  131 


rational  numbers,  6 
as  decimals,  115 
denseness  of,  25 
rational  zeros  theorem,  9 
real  numbers,  14 
real-valued  function,  123 
recursive  definition,  57, 69 
remainder  of  Taylor  series,  250 
Cauchy’s  form,  254 
repeating  decimals,  114 
rhomboid,  361 

Riemann  integrable  function,  277 
Riemann  integral,  271,277 
Riemann  sum,  276 
Riemann-Stieltjes  integral,  321 
Riemann-Stieltjes  sum,  321 
right  continuous  function,  310 
right-hand  limit,  154 
Rolle’s  theorem,  233 
root  test,  99 
roots  of  numbers,  136 

secant  method,  12,259 
selection  function  cf,  66 
semi-open  interval,  20 
sequence,  33 
series,  95 
of  functions,  203 
signum  function,  132 
squeeze  lemma,  44, 163 
step  function,  289 
Stieltjes  integrals,  301,321 
strictly  decreasing  function,  235 
strictly  increasing  function, 

136,  235 
subcover,  90 
subsequence,  66 
subsequential  limit,  72 
substitution,  integration  by,  295 
successor,  1 

summation  notation,  95 
supremum  of  a  set,  22 
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Taylor  series,  250 
Taylor’s  theorem,  250, 253 
topology,  87 

of  pointwise  convergence,  186 
transitive  law,  14 
triangle  inequality,  18,  84 
two-sided  limit,  154 


unbounded  intervals,  29 
uniform  convergence,  184, 194 
uniformly  Cauchy  sequence, 
184,202 

uniformly  continuous  function, 
140,  164 


uniformly  convergent  series  of 
functions,  203 
upper  bound  of  a  set,  21 
upper  Darboux  integral,  270 
upper  Darboux  sum,  270 
upper  Darboux-Stieltjes  integral, 
301 

upper  Darboux-Stieltjes  sum,  300 

van  der  Waerden’s  example,  348 

Weierstrass  M- test,  205 
Weierstrass’s  approximation 
theorem,  218,  220 


